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ABSTRACT 

The Occupational Training Information Systea (OTIS) , 
which is in operation in Oklahoma and in a developmental stage in 
Kentucky, was evaluated. The principle objective of OTIS is to 
provide the information necessary to formulate educational, manpower,^ 
and economic development plans and policies. OTIS consists primarily 
of a manpower demand subsystem, a manpower supply subsystem, and an 

-interface subsystem. These areas were evaluated for their 
effectiveness in the two states. A resurvey was made to determine the 
accuracy of OTIS in predicting manpower demand. In Kentucky the 

'forecasts for manpower demand and supply are inaccurate and the cost 
of the personal interview census is excessive; however, it is 
recommended" that system development be continued if these problems 
are corrected. The favorable factors in Kentucky are the widespread 
support OTIS has and the type of information it provides. (BH) 
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This study was accomplished by professional consultants 
under contract with the Economic Development Adminis- 
tration. The statements* findings, conclusions, recom- 
mendations, and other data in this report are solely those 
of the contractors and do not necessarily reflect the views 
of the Economic Development Administration. 



TABLE OF CONTENTS 



Page 
Number 



EXECUTIVE SUMMARY i 

I. INTRODUCTION 1 

II. BACKGROUND 3 

III. CURRENT OPERATIONS AND FINDINGS 16 

Manpower Demand Subsystem 17 

Manpower Supply Subsystem 46 

Interface, Student Follow-Up» Cost, And Educational 54 
Resources Subsystems 

Overall System And System Impact 59 

IV. RECOMMENDATIONS 68 



Appendices 

A. CONCEPTUAL DIAGRAM OF MANAGEMENT INFORMATION SYSTEM 
FOR VOCATIONAL EDUCATION 

B. SOURCES AND DERIVATION OF OKLAHOMA OTIS COST ESTIMATES 

C. SOURCES AND DERIVATION OF KENTUCKY QTIS COST ESTIMATES 
.V.D. SAMPLE OKLAHOMA AND KENTUCKY QUESTIONNAIRES 



V 



TABLE .OF CONTENTS (Continued) 

RESURVEY METHODOLOGY 
RESURVEY DATA ANALYSIS 

DISTRIBUTION BY REGION FOR EACH STATISTIC 

RESURVEY SUMMARY DATA 

OTIS SUPPLY ADJUSTMENT PROCEDURES 

BLS EMPLOYMENT DATA COLLECTION AND FORECASTING PROGRAMS 



INDEX OF EXHIBITS 



OVERVIEW OF EARLY OTIS MODEL 

ORIGINAL OTIS CONCEPTUAL MODEL 

SAMPLE PAGE CYCLE FIVE REPORT 

OTIS KENTUCKY CONCEPTUAL MODEL 

CURRENT STATUS OF OTIS IN OKLAHOMA AND 
KENTUCKY 

OTIS DEMAND DATA COLLECTION PROCEDURES 

OKLAHOMA AND KENTUCKY DEMAND SURVEY 
ATTRIBUTES 

DISTRIBUTION OF ERROR STATISTICS IN OKLAHOMA 

SUMMARY OF OKLAHOMA FORECASTS BY TYPE 
AND EMPLOYMENT SIZE 

SUMMARY OF OKLAHOMA FORECASTS BY INDU^RY 

OKLAHOMA OCCUPATIONAL FORECASTS BY REGION 

FORECAST ACCURACY BY CLUSTER IN SELECTED 
REGIONS IN OKLAHOMA 

ALL REMAINING EMPLOYMENT FOR OKLAHOMA 

DISTRIBUTION OF ERROR STATISTICS IN KENTUCKY 

SUMMARY OF KENTUCKY FORECASTS BY TYPE AND 
EMPLOYMENT SIZE 



INDEX OF EXHIBITS (Continued) 



Following 
Page 

XVI. SUMMARY OF KENTUCKY FO CASTS BY 37 
MANUFACTURING INDUSTRV 

. XVn. KENTUCKY OCCUPATIONAL FORECASTS BY REGION 38 

XVIII. EFFECT OF CLUSTERING IN KENTUCKY , 39 

— XIX. SUMMARY OF EMPLOYER FORECAST RESPONSES: 42 

KENTUCKY 

XX. DEMAND DATA SUBMISSION DATES BY REGION: 43 
KENTUCKY 

XXI. OTIS STUDENT ACCOUNTING SYSTEM DATA COLLECTION 48 
PROCEDURES 

XXII. COMPOSITION AND SOURCE OF OTIS OKLAHOMA 51 
SUPPLY DATA 

XXIU. COMPARISON OF LMl/OTIS INFORMATION NEEDS 59 

XXIV. OKLAHOMA VOC-ED PLANNING PROCESS 61 

XXV. OTIS DEVELOPMENT AND OPERATING COSTS IN 62 
OKLAHOMA AND KENTUCKY 

XXVL OTIS KENTUCKY DEMAND DATA COLLECTION COST 66 
ESTIMATES 

XXVn. OTIS REPLICATION COST ESTIMATES 66 



BEST CO?V AVAiU&LE 

EXECUTIVE SUMMARY 

The Occupational Training Information System (OTIS) first .was developed 
in Oklahoma during 1968 to provide continuous* timely information for state- 
wide vocational education planning and economic development. Subsequently, 
development of a more comprehensive version of the system was undertaken 
in Kentucky with Economic Development Administration (EDA) and state funds. 
MACRO SYSTEMS. INC. (MSI), was employed by EDA to evaluate this develop- 
mental effort. Since the Kentucky system was still under development, it also 
was decided to examine ongoing OTIS operations in Oklahoma. The purpose of 
this evaluation was to identify the strengths and weaknesses of OTIS and to 
recommend improvements where necessary. These findings and recommenda- 
tions are summarized below. 

I. FINDINGS 

Although OTIS is comprised of several subsystems, the nucleus of the 
entire system is the interface of projected manpower demand with estimated 
manpower supply. Because of the criticality of the demand/supply interface, 
the evaluation focused on the demand, supply, and interface subsystems and on 
the overall system impact. 

1. DEMAND SUBSYSTEM 

Employer forecasts provide the basis for manpower demand projections 
in both Oklahoma and. Kentucky. However, the procedures utilized by each state 
to collect these data differ markedly. 

Oklahoma collects baseline data from a sample of all state 
employers every four years. Only the largest employers 
are contacted personally; the remaining firms receive 
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questionnaires in the mail and are contacted personally only 
if an adequate response for a particular cell is not received. 
The baseline data are updated annually to include new firms 
and significant employment changes for listed firms. 

Kentucky collects data through a personal interview census. 
During the initial year, only manufacturi't;ig employers were 
contacted. 

MSI conducted a resurvey of a sample of the employer^ participating in 
the current OTIS surveys. The resurvey was conducted at th^ end of the fore- 
cast period in both Oklahoma and Kentucky so that forecast eniployment could 
be compared with current employment. 

(1) Oklahoma Employer Forecasts \ 

The forecast of manpower demand made by employers participating 
in the Oklahoma resurvey was underestimated by 1.342 positions. This 
understatement represents an error of 4 percent when related to total 
actual employment and 96 percent when related to the actual change in 
employment. An analysis of the forecasts made by individual firms indi- 
cated that: 

Over 60 percent of the employer forecasts did net increase 
the accuracy which would have been obtained with a simple 
no-change extrapolation. 

When compared to actual employment, nearly 30 perdent of 
the firms made forecast errors of over 20 percent; th? aver- 
age error was over 26 percent. 

« 

Over half of the employers had a forecast error equal to or 
greater than the actual change in employment. The average 
error was nearly 25 percent greater than the change in employ- 
ment. 

Additional analysis indicated that the type of forecast and employ- 
ment size did not affect accuracy substantially. 
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(2) Oklahoma Regional Forecast 

The previous analyses were concerned with the al^iLLty of an employer 
to forecast manpower demand. However, the data produced and utilized 
by OTIS are regional summaries of net manpower requirements by occu- 
pation and /or occupational cluster. Thus, the accuracy of the regional 
' forecasts of manpower demand also was assessed. The results of these 
analyses indicated that: 

When compared to actual employznent, the regional errors 
ranged from nearly 2 percent to over 17 percent. The aver-* 
age error for all regions was approximately 6 percent. 

When compared to change in employment, the regional errors 
ranged from over 8 percent to 67 percent. The average error 
for all regions was slightly over 50 percent. 

Combining the occ^^oational data into vocational education 
clusters did not in.^ rove accurac:^ substantially. 

>• 

The forecast for "All Remaining Employees" did not affect 
the accuracy of the total forecast adversely. 

(3) Kentucky Employer Forecast 

Th*? forecast of manpower demand made by employers participating 
in the Kentucky re survey was overestimated by 1, 100 positions. This 
overstatement represents an error of 2 percent when compared to actual 
\ employment and 98 percent when related to actual change in employment. 
An analysis of the individual forecasts indicated that: 

Over 75 percent of the employer forecasts did not increase 
the accuracy which would have been obtained with a simple 
no-change extrapolation. ] 

When compared to actual employment, over 29 percent of the 
employers made forecast errors of^ver 20 percent; the average 
error was over 30 percent. 

' * \ 
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Over 50 percent of the firms made a forecast error equal to 
or greater than the actual change in employment. The average 
error was nearly 90 percent greater than the change in employ- 
ment. 

Additional analyses indicated that forecast accuracy was not affected 
by type of forecast or employment size. 

(4) Kentucky Regional Forecast 

An analysis of the regional aggregations of OTIS data indicated thatt 

When compared to actual employment, the regional forecast 

errors ranged f;rom less than 0. 2 percent to a high of over 

11 percent. The average error for all regions was 4, 7 percent. 

When compared to actual change in employment, the forecast 
error ranged from a low of 2. 4 percent to a high of over 300 
percent. The average error for all regions was over 100 per- 
cent. 

In addition, combining the occupational data into clusters did not signifi- 
cantly improve forecast accuracy. 

2. SUPPLY SUBSYSTEM 

In Oklahoma, supply totals are comprised primarily of graduates of for- 

mal training programs and registrants with the Oklahoma Employment Service 

I 

Commission (OESC). Kentucky plans to obtain supply data from similar sources. 
With the exception of company-trained individuals, persons receiving formal 
vocational training appear to be adequately covered. However, individuals grad- 
uating from non vocational schools or changing jobs are not included in supply. 
Quantifying the extent of these omissions is extremely difficult. However, the 
results of numerous studies indicate that the number of people available for jobs 

from nonvocational schools and other occupations is considerable. 
I 

yndoubtedly, some of the persons omitted currently from OTIS supply data 
are included in the OESC registrants, which comprise approximately 50 percent 
of manpower supply. However, despite the relatively high Employment Service 
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penetration races in Oklahoma, it is likely that many of these individuals are 
not included xn the OESC totals. Thus, the published OTIS supply figures are 
understated. 

3. INTERFACE SUBSYSTEM ^ 

The interface statistic is the principal output produced by OTIS. This 
statistic is computed by comparing estimated manpower supply for each occu- 
pation within a selected program cluster with projected manpower demand for 
the same occupations. As noted earlier, some of the OTIS forecasts of man- 
power demand are inaccurate and additional sources of manpower supply are 
required. However, even if manpower demand data were accurate and man- 
power supply data complete, the interface statistic must be used with caution 
for the following principal reasons: 

Manpower requirements data are aggregated statewide and by 
region. However, commutation patterns can affect the results. 
For example, an excess of supply for a particular occupation 
statewide or in a particular region may be offset by workers 
commuting to another state or region, e. g. , nearly 36, 000 
more Kentucky residents commute to Ohio than Ohio residents 
commute to Kentucky. 

Net migration may alter the net manpower requirement projec- 
tions over the course of the forecast period by decreasing or 
increasing manpower^upply. 

Many trained individuals qualify for jobs outside the scope of 
their training, e. g. , niany workers have multiple skills and 
demonstrate a high degree of occupational mobility. Thus, 
supply for a particular occupation can change with personnel 
shifts. 

4. SYSTEM IMPACT AND RE PLIC ABILITY 

The principal objective of OTIS is to provide the information necessary 
to formulate educational, manpower, and economic develoisment plans and policies 
Our analysis indicates that: 
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OTIS output inauences directly the Oklahoma state vocational 
education plan. 

Kentucky is incorporating OTIS data into the planning process. 

The annual operating costs of OTIS Oklahoma are approximately $30, 000, 
including approximately $19, 000 for the demand subsystem. In Kentucky, OTIQ 
annual operating costs are estimated to be $185, 000, including over $110, 000 
for the demand subsystem. The relatively low annual operating cost in Oklahoma 
reflects the fact that benchmark demand data are - f;llected through a sample of 
employers every four years. In addition, Kentucky utilizes personal interviews 
exclusively and Oklahoma contacts large employers personally and small emplo;^- 
ers by mail and telephone. In result: , 

Oklahoma obtained data from employers at a field data collec- 
tion cost of approximately $6 per employer. 

Kentucky obtained data from employers at a field data collec- 
tion cost of approximately $28 per employer. 

Thus, the total field cost of collecting demand data from a census of Kentucky 
employees is $1. 2 million. Conversely, a 10 percent sample similar to that 
used in Oklahoma would cost from $29, 000 to $120, 000, depending on the extent 
of personal interviews. Therefore, the additional cost of conducting a personal 
interview census could be more than $1 million. Clearly, the cost of replicating 
the Kentucky OTIS demand data collection methodology is excessive, when com- 
pared to the cost of conducting a sample. 

II. R ECOMMENDATIONS 

In general, OTIS Kentucky has widespread support and is providing the 
type of information required for manpower and vocational education planning. 
However, as noted above, some of the forecasts of manpower demand are 
inaccurate, manpower supply is understated, and the cost of a personal-interview 
census is excessive. Consequently, we recommend that system development be 
continued, if the following four improvements are incorporated to alleviate these 
deficiencies. 
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!• UTILIZE THE OCCUPA TIONAL EMPLOYMENT STATISTICS SURVEY 
TO COLLECT CURREI.r EMPLOYMENT DATA 

The Occupational Employment Statistics (OES) survey program now being 
implemented in Kentucky should be utilized to collect current employment data. 
Although the OES program in Kentucky Is not fully operational, in our judgment, 
this survey can meet the information needs of OTIS users, if the following 
refinements are made. 

Develop jointly a sampling procedure that will permit com- 
pilation of reliable, local-level data. The current employ- 
ment data previously collected by OTIS should be useful in 
developing an appropriate sample. 

Conduct the entire OES survey annually for three years, 
rather than surveying manufacturing, nonmanufacturing, and 
trade employers in three-year cycles. 

These survey data should be utilized immediately to develop regional 
industry -occupation matrices for Kentucky. Subsequently, these matrices can 
be utilized in the projection of manpower demand by occupation. 

2. UTILIZE THE BUREAU OF LABOR STATISTICS (BLS) METHODOLOGY 
TO FORECAST MANPOWER DEMAND 

The National /State IndustryOccupation Matrix System developed by BLS 
should be utilized to forecast employment. During the first year, the BLS 
census-based interim industry -occupation matrix for Kentucky can be utilized. 
Subsequently, the state regional matrices can be utilized with the National/ 
State Matrix System to project manpower demand by occupation. In addition, 
the Employment Service should determin^ppropriate forecast periods in con- 
sultation with major data users; e.g., 3-, 5-, and 10-year projections with 
annual updates. Subsequently, the accuracy of these forecasts of manpower 
demand should be evaluated. 
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3. IMPROVE THE ESTIMATES OF MANPOWER SUPPLY 

The OTIS estimates of manpower supply should be improved by: 

Adjusting the manpower supply figures to include informally 
training individuals, e. g, , individuals from nonvocational 
schools or individuals who have become proficient through 
training or experience on the job. 

Identifying the extent of geographic mobility. Net migration in 
Kentucky is not significant; however, intra- and interstate com- 
mutation do involve a substantial proportion of the work force. 

These improvements require additional research on occupational and geographic 
mobility. 

Additional follow-up studies are necessary to obtain this information. In" 
our judgment, these follow-up studies should be conducted two to five years after 
graduation and should include graduates from non-occupational training programs. 
The results of these studies will provide the data with which to assess the long- 
term impact of vocational training and to determine the occupational and geo- 
graphic gjobility of graduates from all types of schools in Kentucky. 

4. EMPHASIZE THE QUALITATIVE ASPECTS OF VOCATIONAL EDUCATION 
TO INCREASE RAPPORT WITH EMPLOYERS 

One of the important intangible benefits of OTIS is the rapport obtained with 
employers. In our judgment, the level of rapport can be increased by emphasiz- 
ing the qualitative aspects of vocational education, rather than data collection. 
For example, under current procedures, rapport is sought by asking the employer 
for current and forecast employment by occupation and emphasizing the benefits 
of OTIS. This is done within the tight time constraints necessary to meet data 
collection requirements. Consequently, scheduling and conducting interviews 
are difficult for both vocational education personnel and employers. 

Using the OES/BLS demand data collection and forecasting methodology, 
the industrial coordinators will receive the OTIS forecasts for their region. Subr 
sequently, as part of their normal functions, the coordinators can discuss these 
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occupational projections and related information with employers. More impor- 
tantly, they can take the time to discuss the qu ditative aspects of vocational 
education, e.g., the characteristics of a typical job and/or worker. 

Job characteristics include duties, working conditions, hours, 
wages, shifts, fringe benefits, and opportunities for advance- 
ment 

Employee characteristics include skills, attitudes, physical 
requirements, educational and training requirements, and 
work experience 

In addition, current vacancies for placement purposes, potential technological 
changes, such as the introduction of new machines or products, and the employ- 
er's recent experience with vocational education graduates should be discussed, 
tn our judgment, bringing a forecast to the employer, obtaining his ideas on its 
validity, and discussing how vocational education can meet his particular needs 
will result in a higher level of rapport than exists currently. 
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[. INTRODUCTION 



The Occupational Training Information System (OTIS) was first developed 
in Oklahoma in 1968 to provide continuous, timely information for statewide 
vocational education planning and manpower development. Subsequently, the 
Bureau of Vocational Education of the Kentucky State Department of Education 
and the Economic Development Administration (EDA) of the U. S. Department 
of Commerce became interested in the system. Bureau personnel believed that 
the system would satisfy needs for new and more specific information to sup- 
port planning efforts. EDA was interested because the additional information 
provided by OTIS and resultant planning improvements could (1) maicimize the 
utilization of EDA -funded educational facilities and <2) provide the skilled 
craftsmen necessary to sustain economic growth. Consequently, development 
of OTIS in Kentucky was undertaken with state and EDA funds. - 

The original OTIS conceptual model was comprised of six interrelated 
subsystems. Subsequently, this model was considerably revised and a more 
comprehensive version formed the basis of the Kentucky model. In addition, 
the scope of the Kentucky model was broadened by the addition of several new 
subsystems to give greater emphasis to manpower planning. However, the 
original objectives of the system were not changed substantially. 

.Currently, OTIS in Kentucky is under development, and only four sub- 
systems have been implemented. Further, only one subsystem, the demand 
component, is totally operational, but data have been collected and processed 
for manufacturing industries only. Bureau personnel in Kentucky want to 



1/ In Kentucky, OTIS is known as the Kentucky Information for Training and fiiucatioii System (KITES). 



proceed with this developmental effort and several other states are also Inter- 
ested in installing similar systems, particularly if federal funding is available. 
Consequently, EDA requested an evaluation of OTIS prior to committing addi- 
tional funds for system expansion or replication. 

MACRO SYSTEMS, INC. (MSI), was employed by EDA to conduct an eval- 
uation of the OTIS developmental effort in Kentucky and to examine ongoing OTIS 
operations in Oklahoma. The purpose of this evaluation is to ascertain the 
strengths and weaknesses of the system and to recommend improvements. where 
necessary. Our evaluation focuses on OTIS Kentucky because the system cofii-^ 
cept is more comprehensive and the development partially funded with EDA 
monies. The results of this study are presented in the following chapters. 

Chapter II describes the background, concept, and current 
status of OTIS in Oklahoma and Kentucky. 

Chapter III describes current OTIS operations and costs and 
presents our findings regarding the operational effectiveness 
of the various subsystems and the overall impact of OTIS, 
including system replicabilityi^ 

Chapter IV presents our recommendations regarding system 
improvements and/or replication. 

Relevant background material and detailed information supporting our analyses 
are included in the appendices. 
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OTIS was first implemented in Oklahoma. Since implementation, the 
system has been revised substantially. Currentty, a more comprehensive 
version of OTIS is un«er development in Kentucky. This chapter presents our 
understanding of the conceptual and operating models implemented in each state. 

1. TFIE OTIS CONCEPT WAS DEVELOPED BY OKLAHOMA IN 1968 

The ultimate objective of vocational education, as specified in the 1968 
amendments to the Vocational Education Act of 1963. is employment for pro- 
gram graduates. Equally important, trained individuals are necessary to sus- 
tain economic growth. Realization of these objectives requires accurate fore- 
casts of manpower demand and supply. Accordingly, forecast requirements 
were the focus of two major studies completed in 1967 by Ling-Temco-Vought. 
Inc.i'' and Oklahoma State University. 2/ The results of these occupational 
studies indicated a need for an operational data system to provide continuous, 
tiniely informaUon for statewide vocational education planning and manpower 
policy development in Oklahoma. 

Subsequently, representatives from the Research Department of the 
Oklahoma Industrial Development and Park Department, the Oklahoma Depart- 
ment of Vocational and Technical Education, the Oklahoma Employment Security 
Commission (OESC). and the Manpower Research and Training Center at 



T/ Ung-Tcmco-Vought, Inc. (Prin« Contractor), Sy«eim Management Services, Vocational and Tectolcal 

Skills and Uteracv Systems. Report II: Washington, D. C: Ozarlqi Regional Commission, December, 1967. 

2/ Braden, Paul V. and Roney, Maurice W. , Occupational B facation Bevond the tfigh School in Okl^qma: 
Ananalyticalstudy with recommendatioM for a statewide system for manpower development, StiUwater, 

C&lahoma: The Reseaich Rmndation, Oklahoma State Univcssitjr, January, 1968, 



N Oklahoma State University met to study the need for a data system to provide 
information necessary to support the state's vocational training and economic 
development programs, hi response^ a proposal to develop a statewide man- 
power data system was prepared by the Manpower Research and Training 
Center. The results of the Initial research emphasized the establishment of 
system parameters, including: 

Potential user population 
Information and user linkages 
Information input processes 

Report formats for data analysis and dissemination 
Information feedback and system modification procedures 
User involvement strategies to ensure system effectiveness 

Based upon the specification of overall user requirements and other pertinent 
system parameters, data were collected and the first annral OTIS Cycle Report 
was published in January, 1969. A/ 

The first report was necessarily incomplete due to the short time period 
between project approval and completion. However, this report did furnish the 
requisite operating experience to enable system development to be continued. 
As a result, a second Cycle Report contained significant refinements. Further, 
the success of the efforts over the two-year period led to the permanent desig- 
nation of system operating responsibility. The State Department of Vocational 
and Technical Education was selected as the operating agency, based on the 
assumption that as the prime user of OTIS, this department would be the logical 
■ focus of operations tr assure maximum effort and interest during implementation. 
Currently, this agency exercises full operating responsibility for OTIS within the 
context of agency planning and analysis functions. The major share of these 



1/ The OTIS Final Report gives credit for the fystem concept to Dr. Pat Choate (then Director of Research) and 
Mr, George Appley of the Industrial Development and Park Department, and for syrstem development, to Dr, 
Paid V. Braden of the Manpower Research and Training Cexiter who served as Project Director. Dt. Braden 
. was assisted by researchers Dr. Krishan JPaul and James L* Hairis. Braden, Paul V. , et Occupational 
Training Information System (OTIS) Final Report. Research Foundation, Oklahoma State University, Still- 
water, Oklahoma, 1970, 
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operating activities is performed by the Research. Planning, and Evaluation 
•Division. However, manpower demand data are collected and edited by the 
OESC. 

2. THE ORIGINAL OTIS CONCEPTUAL MO DEL CONSISTED OF SIX 
INTERRELATED SUBSYSTEMS 

OTIS was developed over a two-year period. Exhibit I. following this 
page, presents an early version of the OTIS model. The early model included 
only fpur subsystems: supply, demand, interface, and cost/benefit. Exhibit II. 
following Exhibit I. presents an overview of the OTIS model as it was designed 
'for implementation in Oklahoma. This exhibit depicts the functional relation- 
ships among the six major conceptual subsystems described in the OTIS Final 
Report.-'^ 

The principal objectives of the original OTIS model were to provide, on 
local, regional (infrastate). and state bases, the planning and operating infor- 
mation necessary to: 

Permit the formulation of manpower planning strategies and 
assist in manpower decision -making 

Enhance the formulation of viable economic development 
policies and programs 

Establish needed vocational and technical training programs 

Enhance program graduate employment potential 

Facilitate development of programs for specific groups such 
as the handicapped 

Meet legislative and community accountability requirements 



1/ A conceptual diagram was not included in the OTIS Hnal Report. Hence, this overview was developed by 
MSI, based on the description of the system contained in the report. 
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EXHIBIT 1 
Economic Developmeitt AdminSstxatioa 
OVERVIEW OF EARLY OTIS MODEL 
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May> 1970. 



pjs^ con 



EXH»rr n 

Economic Developmcmt Adminlstiatiioii 
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It was determined that these objectives could be met through the develop- 
ment of a model based on the collection, analysis, and comparison of manpower 
supply and demand data. In concept, the OTIS model functions as foll,ows: 

Manpower demand data by occupation (DOT code) are collec- 
ted from employers. These data represent the estimated 
number of jobs that will result from the expansion or reduc- 
tion of manpower m-?eds. Subsequently, these data are adjusted 
for replacement and summarized on regional and state levels. 

Manpower supply data are collected on planning areas and 
statewide bases. Manpower supply is defined as the total 
^. • number of prospective employees receiving training in vari- 

ous vocational educational curriculum clusters or those cer- 
tified by the employment service. 

Net additional manpower requirements are calculated by 
region for each cluster. The nucleus of the model is the 
comparison of the demand and supply figures for each clus- 
ter. The net result, either a demand or supply surplus, is 
summarized in a report called the OTIS Cycle Report. 
Exhibit III. following this page, presents a sample page from 
the Oklahoma report. 

These net demand data are used with information from other subsystems to 
faciUtate the formulation of vocational education policies. The entire Wnpower 
^cision-making process takes place within an environment of socio-political 
involvement, i. e. , policies are made within the context of community- and 
agency-wide partibipatl(^n. Thus, obtaining broad-based participation in both 
the formulation and implementation of plans and policies is fundamental to OTIS. 

The six major subsystems comprising the initial OTIS model are described 
below. 

(1) The Manpower Supply Subsystem Was Designed To Furnish Labor 
Market Entrant Information 

The objecti\ e of the manpower supply component of OTIS is to pro- 
vide information concerning the number of trained individuals entering the 
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labor market In any forecast year. In the initial model, most of these 
individuals were graduates from publicly funded vocational and technical 
education programs. A corollary objective of the supply component was 
to collect data necessary for a detailed evaluation of the vocational edu- 
caUon curriculum. Thus, in addition to a numerical count of students 
enrolled in a variety of skill programs, the following data were collected; 

Student names and addresses for follow-up 

Student characteristics data 

Economic status 
Career goals 

Ethnic and social background 
Physical or mental handicap 

These data, particularly student characteristics information, were to 
be collected jointly from students and teachers, and utilized in the prepar- 
ation of a. summary management report. 

The student accounting system was selected as the primary mech- 
anism for the collection of the supply data. However, other sources of 
supply data have been recognized and are included in the total supply data 
. component. The additional sources of supply data and the student account- 
ing system are discussed in detail later. 

(2) The Manpower Demand Subsystem Was Design ed To Furnish A 
S hort-Term Forecast Of Labor Market Requirements 

. The OTIS demand component was conceived to yield a short-term 
forecast of ipanpower demand, where demand equals available new jobs 
plus estimated replacement positions. This component processes short-^ 
term employer estimates of manpower demand by occupation (DOT code) 
and aggregates these data on state and regional bases. In turn, these 
occupational demand forecasts are used to determine the net demand for 
specific vocational education training skills. 



The principal objectives of the initial demand subsystem were to: 

UvlUze the benchmark demand data for nonfarm wage and 
< salary employment collected previously by the OESC 

Develop specific methodologies for coUecting agricultural 
manpower demand data and generating acceptable agricul- 
tural forecasts 

Collect occupational manpower demand data to update the 
OESC benchmark data 

Develop a significant rapport between educators and repre- 
sentatives of industry 

The initial demand data were collected by contacting personally aU 
manufacturing employers in the state.!/ Most of the data collectors were 
occupational educators or industrial coordinators. This technique was 
selected to foster maximum personal contact and rapport between edu- 
cators and the private sector to: (1) ensure employer participation; (2) 
assist in the development of the occupational forecast; and (3) enhance 
placement prospects for vocational /technical graduates.S.' The demand 
data procedures currently utilized in both states are described in Chap- 
ter III. 

(3) The Interface Subsystem Computes Net Manpower Demand For E ach 
Cluster Of Training Programs 

The interface subsystem compares manpower supply and demand. 
Forecast demand and supply are Usted for most occupations associated 
with selected training program clusters. Total manpower demand and 
total manpower supply figures for each cluster are computed by adding 
the figures for each occupation. Subsequently, the anticipated supply of 

7} These data were ^Uzed in the initial system development but were not included in the Cycle Cne Repot. 

2/ Btadca, Paul V. . et al, Oc««>ational Tr- ^^^T faformatim. ^^tt. ^<yn&^ Final Report. Research Founda- 
tion, Oklahoma State Uaiveisity, Stillwater, Oklahoma, 1970, 
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trained personnel is subtracted from forecasted demand to obtain the net 
manpower requirement or surplus for each training cluster. Exhibit III, 
following page 6, presents the results of this process. The net require- 
ments calculaUon is the nucleus of the OTIS model and provides requisite 
information for vocational education and manpower planning. 

(4) The Initial Cost Data Subsystem Was Designed To Collect Information 
Concerning Costs Per Student 

The cost data subsystem was designed initially to collect the infor- 
mation necessary "to conduct program cost /benefit analyses. The results 
of these analyses were intended to provide the basis for resource alloca- 
tion and a breakdown of the total expenditures for vocational education 
into specific program areas. The average cost per student is computed 
by dividing the costs for a specific program by the number of students 
enrolled in the program. 

Although specific objectives for gathering detaUed analytical program 
cost data are not presently defined, it is apparent that such data could 
provide significant input to decisions regarding curriculum mix. For 
example, -cost information might indicate that a proposed program, which 
would benefit only a small group of students, requires inordinately large 
amounts of capital and personnel. Thus, a low-priority ranking could be 
accurately ascribed to the program. 

(5) The Initial Graduate FoUow-Up Subsystem Was Designed To Collect 
Postgraduate Job Placement Data For Program Evaluation 

The graduate follow-up subsystem was conceived to collect infor- 
mation from program graduates. These data, in turn, were intended to 
assist curriculum pla?iners in the development of a data base for evaluat- 
ing program impact. Specifically, this subsystem was designed to produce 
three major evaluative reports. 
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Mobility Pattern Report - -This report was intended to present 
information concerning the locational changes of program 
graduates over time. Based on the comparison of training 
and employment site Zip Codes, a series of these reports 
would describe the movements of individual program gradu- 
ates and discernible patterns for the group. 

Subsequent Employment Of Graduates Report — A major diffi- 
culty in assessing the impact of training involves determining 
the impact of specific training and skills upon the type of 
employment obtained by a program graduate. Accordingly, 
the objective of this report was to correlate and present train- 
ing and employment data. The data collected in the foUow-up 
subsystem were aimed at providing some, indication of training/ 
job linkages. 

Graduate Salary Study Report— A major issue in vocational 
education and manpower planning is the extent to which pre- 
employment skills training increases the entrance wage and 
long-term earning potential of an enroUee. Thus, training- 
related earnings increases represent a significant evaluative 
indicator of program effectiveness. Accordingly, the Graduate 
Salary Report was designed to display the salary levels of 
program graduates and identify salary differentials among 
graduates of different training programs. 

Initially, the graduate follow-up subsystem was designed to collect 
data on 20. 000 students annually through direct mailings. As many as 
three follow-up mailings per student were contemplated. At the same 
time. foUow-up methods utilizing instructor contact with graduates were 
tested. After comparing both methods, the teacher follow-up method 
was selected as "faster and less costly. " However, neither approach 
produced the anticipated results.!/ Consequently, the graduate follow-up 
subsystem has been incorporated into Tne student accounting system. 



Ress-jarch Cooniinating Unit, IVo<cct Report g7 . Oklahoma State Department of Vocational and Technical 
Biucation, Stillwater, Oklahoma, p, 11. 



-10- 



•TCI ''■■^ 



<6) The Initial Underdevelcped Human Resources Subsystem Was 
Designed To Identify Special Requirements Of Specific Labor 
Market Entrants 

The purpose of tl.j underdeveloped human resources subsystem was 
to identify specific population groups in need of special or supplementary 
services and training experiences. This target population is defined 
generally as unemployed, underemployed, and /or disadvantaged, and it 
includes culturally deprived as well as physically and mentally handicapped 
individuals. 

Initially, attempts were made to collect general population profile 
data through a test survey in the Tulsa area. Approximately 285, 000 
questionnaires were distributed randomly in the street. However, only 
5,045 usable responses were obtained. Subsequently, the idea of identify- 
ing the underdeveloped human resources in the general population was 
-dropped and an alternative approach of collecting data on training program 
enroUees through the student accounting system was adopted. 

3. THE OTIS CONCEPTUAL MODEL HAS BEEN MOPIP^IED EXTENSIVELY 
FOR REPLICATION IN KENTUCKY 

OTIS has evolved continually since its development began in Oklahoma in 
1968. A more extensive version of the original OTIS model led directly to the 
formulation of the Kentucky OTIS model. The basic objectives of OTIS do not 
appear to have undergone substantial, change in the Kentucky model. However, 
several subsystems have been modified and the addition of new subsystems has 
broadened the scope of the Kentucky model to include greater emphasis on man- 
power planning, of which vocational education is a significant part. Exhibit IV, 
following this page, displays the overall Kentucky OTIS model. The four addi- 
tional subsystems developed for Kentucky are summarized in the following 
sections. 
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(1) The Goals And Objectives Subsystem Was Designed To Focus 
Attention On Key Human Resources Development Issues 

The objective o^ the goals and objectives subsystem is to establish 
procedures for formulating "realistic goals and objectives for agencies 
which provide manpower-related services. . . "i^ This subsystem was 
designed to link conceptually the manpower supply and demand components 
and public policy with the planning and decision -making processes. This 
approach to data organization has the potential to provide information for 
considering planning strategy, goals, and objectives. However, the 
actual definition of this component is not defined by available documents. 
Moreover, the focus of the goals and objectives subsystem described in 
the OTIS literature differs from that described by other researchers 
working on the Kentucky system.2.'' Exhibit IV, following page 11, pre- 
sents the original Kentucky OTIS conceptual model. The revised model 
described by other researchers is included in Appendix A. 

(2) The Educational Resources Subsystem Was Designed To Identify 
Itonan And Capital Resources For Allocation By Planning 
Decision-Makers 

The educational resources subsystem represents an effort to 
develop capital and plant requirements data and personnel resources 
data for inclusion in the planning process. Shifts in educational policy, 
resulting from an examination of manpower supply and demand data and 
other labor market and economic condition indicators, have an impact 
upon the utilization of the total resources of the educational system. 
Thus, an inventory of these resources is necessary. This would enable 

Jf n^A^^^ Pa»l V, ■ Pfopncal for Regearch And/ Or Relatfid Activities; Adaptation And InrtaUation Of The 

Occupational Training Information System {QTK ^ In Selected States And Districts Within The Southeastexp 
EDA Region. Occtjpational Training Information Syrtem*, Inc. : MaJfch 1972, p. 9. 

2/ Hadaajr, D. C , aadBraden, P. V. , An Overview O f n»e C&morehentive Data Svttem Par Occupational 
Bfacation; (The Center for Research and Leadejship Development in Vocational Biucatiott, The Ohio State 
Utdveiffity , uJ5>ublished paper— D, ) pp. 3-5, 
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the planner to identify precisely the level of resources required to imple- 
ment proposed educational changes. However, the development of this 
potentially important component has not progressed beyond the develop- 
ment of an inventory file. 

(3) A Training Process Subsystem Was Formulated To Monitor 
Critical Training Variables For Program Upgrading 

Exhibit IV, following page 11, shows training process characteris- 
tics as Input information into the manpower supply component. Qualita- 
tive curriculum information would be useful to anticipate not only the types 
of sk^s being imparted to enrollees, but also how well these skills were 
were being taught. This component appears to call for the identification 
of specific training techniques or curriculum outputs in terms of their 
causal relationships with enrollee employment success. At a minimum, 
therefore, a variety of impact evaluation studies to test for significant 
curriculum variables would be required. It appears that some of this 
requisite employment experience data could be collected through the 
student follow-up subsystem. However, neither the operating linkages 
nor a generalized procedural approach have been formulated. 

(4) The Delivery System Strategy Selection For Manpower Development 
Programs Subsystem Was Formulated To Establish Allocation Priorities 

The delivery System strategy selection for manpower development 
programs subsystem was conceived to collect requisite system inputs and 
utilize these data to allocate resources. The objective of this component 
is to organize all data collected during the OTIS process and present a set 
of feasible operating strategies for review within the framework of the 
socio-political environment. Within this environment, the exact relation- 
ship among the elements of this subsystem, the goals and objectives sub- 
system, and a variety of other data or information inputs is not clear. 
Elements such as needs, opportunities, and problems appear to constitute 
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the cognitive input of planners developed from the information collected 
by the OTIS subsystems. These data contribute to the formulation of 
policy-level goals and objectives and, thus, to the development of the 
delivery system strategy. 
4, THE OTIS CONCEPT HAS NOT BEEN TOTALLY IMPLEMENTED 

Extensive interviews with personnel in Oklahoma and Kentucky have indi- 
cated that neither OTIS conceptual model has been implemented fully. Exhibit 
V, following this page, presents the current status of development of the sub- 
systems comprising the original conceptual model in each state. As indicated, 
the subsystems implemented in Oklahoma are: 

Manpower Demand Subsystem 
Manpower Supply Subsystem 
Interface Subsystem 

In addition, the follow-up subsystem has been implemented by and incorporated 
. into the state's student accounting system; underdeveloped human resources data 
are collected by the student accounting system; and an extremely limited version 
of the cost subsystem was developed as part of OTIS. Subsequently, the OTIS, 
cost subsystem was dropped and a completely new cos: system developed and 
implemented as part of the Oklahoma Department of Vocational Education Man- 
* agement Information System. 

On the other hand, in the OTIS Kentucky model, only the demand subsys- 
tem of the 10 subsystems comprising the model is implemented. However, four 
other systems are under development. 

The manpower supply subsystem is being developed by state 
personnel. 

The interface subsystem is being developed and programmed 
in conjunction with EDA personnel. 
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The follow-up subsystem is being developed by the Center 
for Vocational and Technical Education at Ohio State Univer- 
sity. 

An inventory file of educlitional resources has been started. 

sjc * ❖ ?N 

This chapter has presented a discussion of the conceptual OTIS models 
and has described the current status of the systems actually implemented in 
Oklahoma and Kentucky. The next chapter describes current system opera- 
tions and presents the findings resulting from our analysis of OTIS operations 
and utilization. 



Ill, CURRENT OPERATIONS AND FINDINGS 



The purpose of this study Is to evaluate OTIS Kentucky and to examine 
: ongoing OTIS operations in Oklahoma. Therefore, questions concerning the 

accuracy, operational effectiveness, and overall impact of OTIS must be answered. 

The operational effectiveness of the system can be determined by responses to 
* questions about the individual subsystems. Specific questions relevant to each ^ 

subsystem are: 

. Demand Subsystem — Are the data collection procedures effi- 
cient? Are the data processed effectively? Are the forecasts 
of manpower demand complete and accurate? Do the data 
sources and collection procedure's used by OTIS complement 
or duplicate Department of Labor (DOL) sources and proce- 
dures? Does OTIS data bank duplicate existing DOL data? 

Supply Subsystem — Are all sources of manpower included? 
Are data processed efficiently? Axe forecasts accurate and 
complete ? 

Interface Subsystem — Are the interface procedures efficient? 
Are net manpower requirements presented and utilized prop- 
erly? Are interface tables timely and error free? 

Follow- Up Subsystem — Does training influence placement or 
career patterns? Does feedback data result in system changes? 

Underdeveloped Human Resources Subsystem ^-Axe' under- 
developed human resources identified? Are supplemental 
training and assistance provided ? 



Cost Subsystem — Are the cost data useful for resource alloca*- 
tion? 

Goals And Objectives Subsystem - -A re realistic goals and 
objectives established and performance monitored? 



Educational Resources Subsystem - -Is an inventory of plants 
and equipment compiled and used for resource allocation? 

Training Process Subsystem — Are the outputs of other sub- 
systems utilized to develop operating strategies ? 

Questions concerning the overall system and system impact include: 

Does OTIS provide the information needed for vocational and 
technical education planning? 



Are system outputs utilized to adjust the program mix and/ 
or to maximize the utilization of educational resources? 

Does the reallocation of resources enhance the placement of 
vocational and technical graduates? 

V . Does OTIS provide the information needed for manpower plan- 

ning and /or formulation of economic development strategies? 

Can OTIS be exported or replicated easily and inexpensively? 

Clearly, many of these questions are interrelated. More importantly, 
several of the OTIS subsystems are not operational so that some of the ques- 
tions cannot be answered. The demand /supply interface is the nucleus of OTIS. 
Because of these limiting conditions and the criticality of the demand /supply 
interface, our evaluation focuses on the demand and supply subsystems and on 
the overall impact of the system. The results of our analyses of OTIS in Okla- 
home and Kentucky are presented subsequently. Findings about the subsystems 
are presented first, followed by our analysis of the total system and its inxpact. 

MANPOWER DEMAND SUBSYSTEM 

This section describes the demand data collection procedures utilized in 

Oklahoma and Kentucky and presents our findings regarding the manpower demandL 

component. Specifically, the following aspects of the demand subsystem are 
- . « 
tcussed: 
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The similarities and differences between the demand data 
collection methodologies currently utilized in Oklahoma and 
Kentucky 

The accuracy of the employer forecasts of manpower demand 

The relative accuracy of forecast demand by type of forecast, 
size of firm, and industry 

' . The accuracy of the occupational forecasts by region 

The effect of clustering on the accuracy of the occupational 
forecast 

The problems encountered in collecting the demand data in 
Kentucky 

Thfi comprehensiveness of the manpower demand data utilized 
by OTIS 

1/ GKLAHOMA AND KENTUCKY UTILIZE DIFFERENT PROCEDURES TO 
COLLECT MANPOWER DEMAND DATA 

Employer forecasts provide the basis for projecting demand in both Okla- 
homa and Kentucky. However, the procedures utilized by each state to collect 
these data differ markedly. 

Oklahoma collects data from a sample of state employers. 

Kentucky collects data from a census of employers of a par- 
ticular type, e. g. , all manufacturing employers. 

Eschibit VI, following this page, ll^strates the manpower demand data collection 
process for each state. Further, Exhibit VII, following Exhibit VI, compares 
the attributes of the Oklahoma and Kentucky survey methodologies. 

In both states, the demand data collection activity depends upon personal 
contacts between employers and trained representatives of the OESC or the 
Kentucky State Department of Vocational Education and other state agencies. 
Personal contacts are emphasized to attempt to assure that employers produce 
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Economic Development Administration 

OKLAHOMA AND KENTUCKY 
DEMAND SURVEY ATTRIBUTES 



Attribute 


Oklahoma 


Kentucky 






Memorial Day, 1971 - Labor Day, 
1971 


June, 1972-»>»No end date established 




Data Submiision Cut<-Q£F 
Date 


September 15, 1971 


No cut»o£f date established; data 
outstanding on Eebmcry 28^ 1973 


3. 


Fbrecast Target Date 


June, 1971 


May, 1972 


4. 




All business and govemmeiA 
^ychiding the self*<emplo)red 


Mami&tcturing 


s. 


&i^lcyer Idesti£lcati<m 
Technique 


Employment Security records 
maintained by OESC 


Directory of Manufacturers, pub- 
lished by Kentucky Department of 
Commerce, and Employment Ser- 
vice data 


6. 


Stratificatioa Tecboique 
for Saxopla 


Separate by major industry divi« 
siod^ arrange busineia by region 
and employment determine 
quartile separatioi;^ select sample 


Stratification not required; census 
survey 


7. 


Sanq>le Ratio Selection 
Sir OuxtxtilA: 








. fJjft 

• Second 

• Third 
. Fourth 


100 percent 
100 percent 
20 percent 
5 percent 


100 percent 
100 percent 
100 percent 
100 percent 




Survev Data Collect! on 
Instmrrents 


Special schedules prepared by 
OESC 


Schedules prqpared by BLS for the 
Occupational En^loyment Statistics 
(OES) program modified by 
Kentucky 


9, 


Data Collection Pessonnel 


Graduate students hired by OESC 


Personnel £Eom various state agencies 


10. 


Collection Pextonnel Training 


Obae week, conducted by OESC 


l| days, conducted by OTIS, Inc« 




Sumy Req>o»9e Resulti 


4 






• Mimber contacted 

• Usable reiponieit 
^ Reqponie ratio 

• B^bliilixnent esq>lo)fine2)t 


2,636 
1,865 
71 percent 
84 percent 


2,307 
2,175 
94 percent 


» 

C 


Data modification 


OESC penonne! review all data for 
accmacy and modify where neces- 
sary 


Miarin^ and/ or incorrect data are 
returned to Industrial Coordinator 



reliable employment demand forecasts and to establish rapport among the public 
and private sector organizations involved. 

(1) Oklahoma Contacts Sample Employers By Perso nal Visits And 
By Mail 

As noted earlier, during the early stages of OTIS development. 
Oklahoma endeavored to collect demand data from all employers on a 
census basis. Vocational education personnel were utilized to collect 
these data. This method was founJ be very expensive and was not 
utilized. 

Currently, demand data are collected through a sample of state 
employers conducted by OESC. The largest employers in terms of total 
employment are contacted personally. The remaining firms receive sur- 
vey questionnaires in the mail and are contacted personally only if an 
adequate response for a particular cell is not received. 

In Oklahoma, baseline data are collected every four years and are 
updated annually to include new firms and significant employment changes 
for listed firms. As noted in Exhibit VII. following page 18. the 1971 
sample survey was stratified as follows: 

OESC records were utilized to identify all businesses that 
paid a wage to four or more workers in each of 20 weeks . 

The state was divided into 11 state planning districts. 

The employers in each industry division in each district were 
ranked in descending order by total employment. 

The employers in each area were divided into quartiles. based 
on total employment per firm. 



\ 



The sample was selected as follows: 

100 percent of the first two quartiles 
20 percent of the third quartile 
5 percent of the fourth quartile 

The selected sample was adjusted to include noncovered firms 
and major employers not otherwise included in the sample 
stratification. 

Overall, the Oklahoma sample included 416 manufacturing and 2,217 non- 
manufacturing establishments employing approximately 375, QOu people. 
The response rate for the sample was approximately 71 percent, or 
1, 865 reporting units. 

The most recent demand data in Oklahoma were collected by gradu- 
ate students utilizing survey questionnaires developed by OESC. These 
questionnaires included more than 280 occupations classified by the Dic- 
tionary of Occupational Titles (DOT) code. A sample questionnaire is 
included in Appendix D. Employers were asked to forecast the demand 
for each occupation for two- and four-year periods. 

<2) Kentucky Conducts A Personal Interview Census 

The initial Kentucky demand data collection activities focused on 
conducting a census of the manufacturing employers listed in the Kentucky 
Directory of Manufacturers, published by the State Department of Com- 
merce. Thus, Kentucky data collection does not involve a stratified sample 
such as was undertaken in Oklahoma. Instead, all manufacturers were 
surveyed with the following results, as of September, 1973. 

2, 946 employers were in the universe. 

2,855 employers were contacted. 

374 were nonmanufacturers. who were thereby eliminated 
from the survey population. 
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275 firms were determined to be inactive, i.e. , out of 
business. 

69 employers refused to respond. 

61 employers never were contacted. 

Thus, a total of 2» 175 usable responses, exclusive of nonmanufacturing^ 
and inactive firms, were received, giving an overall usable response rate 
of approximately 94 percent. Employers responding employ approximately 
214,000 of the 234, 500 manufacturing employees. 

The demand data were collected by over 500 individuals, including 
vocational education teachers and a variety of individuals from other 
agencies. Thirty-four different Bureau of Labor Statistics (BLS) Occupa- 
tional Employment Survey (OES) questionnaires, including some 1, 400 
occupations, were utilized to collect the data. A sample questionnaire 
is contained in Appendix D. Employers were asked to forecast manpower 
demand by occupation for one- and two-year periods. 

2 -^HE FORE CAST OF MANPOWER DEMAND MADE BY EMPLOYERS 

PARTICIPATING iN THE OKLAHOMA RESURVEY WAS UNDERESTIMAT ED 

The nucleus of the entire OTIS system is the interface of projected man- 
power demand with estimated manpower supply. The forecasts of manpower 
demand are prepared by employers. Therefore, an assessment of the accuracy 
of these employer forecasts is crucial to an evaluation of the OTIS demand data 
collection methodology. 

An assessment of the overall reliability of the OTIS demand data requires 
an analysis of all aspects of employment forecasting both by firm and by regional 
summaries of occupational data. Relevant questions concerning the ability of 
Individual employers to forecast include: 
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Are specific, individual employer forecasts accurate? 

Does the accuracy vary by type of forecast, e. g. , change or 
no change, or by size in terms of employment? 

Are the aggregate forecasts of employers in some industries 
better than in others? 

* Are forecast errors associated with particular independent 
variables, e.g., number of occupations? 

More general questions concerning the occupational forecast include: 

Are the regional summaries of manpower demaud by occupa- 
tion accurate? 

Do the forecasts of "All Remaining Employees" adversely 
affect the overall accuracy of the occupational projections? 

Does clustering improve the accuracy of the regional summaries? 

To answer questions of this type, a comparison of the OTIS forecast employ- 
ment figures with actual employment figures is necessary. Therefore, the Proj- 
ect Monitoring Committee decided to resurvey 200 firms that had participated in 
the current OTIS survey in Oklahoma. The resurvey was undertaken at the end 
of the two-year forecast period, thereby enabling forecast employment data to be 
compared with current actual employment. The resurvey methodology, including 
sample selection and survey procedures, is described in Appendix E. The 
results of this comparison indicated that the forecast of manpower demand was 
underestimated by 1, 342 positions. This understatement represents an error 
of 4 percent when compared to actual employment and 96 percent when related 
to actual change in employment. During the forecast period, employment in 
Oklahoma, excluding agriculture, increased approximately 9 percent.!'' 



1/ Unpublished BLS data 
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Alternative statistics for evaluating the accuracy of the OTIS forecast 
were being developed concurrently with data preparation. After extensive 
analysis, the Project Monitoring Committee decided to use the following three 
statistical measures to evaluate the accuracy of the OTIS demand data. 

U Statistic — This statistic was developed by Henri Theili/' 
and has been used previously to evaluate the accuracy of 
employer forecasts of manpower demand.- The U Statistic 
is calculated as follows: 

/ I(P. - A.)2 
U = / ^ 

i E A? 

I 

where P. and A. stand for predicted and actual changes. Thus, 
it can be^ seen tJiat U - 0 only if all forecasts are perfect and 
that U = 1 when the prediction error is of the same magnitude 
as a no- change extrapolation. In other words, "by using the 
inequality coefficient one measures the seriousness of a pre- 
diction error by the quadratic loss criterion in such a way that 
the zero corresponds with perfection and the unit with the loss 
associated with no-change extrapolation. It will be clear that 
the inequality coefficient has no finite upper bound, which is 
tantamount to saying that it is possible to do considerably 
worse than by extrapolating on a no-change basis. However, 
as discussed subsequently and illustrated by the OTIS data, , 
the U value of an incorrect "no-change" forecast is 1.0 
regardless of the magnitude of the error. 

Statistic I- -This is a relatively simple statistic that relates 
the forecast error to total actual employment. The formula 
for deriving Statistic I is: 



„ . r Total F orecast - Total Actual 
Statistic I = Total Actual 

The forecast error is computed using only total employment 
for the employer or particular aggregation. Thus, errors in 
individual occupational forecasts, comprising the employers' 
total forecast, can be offset by other line items or by the 
regional summaries. 

^ Theil. Henri. Applied Eeonomic Foiecagtdgg. Rand McNally G Con^ary, Chicago, 1966, 
2/ Mocer, Collette H, , An Eyaluation Of Area SMU Surveys M A Ba d s For Maapovyer PoUcies. a n u:5>ublislied 
doctoral dioeztation at the Univttsity of W^consin, 1971. 



/■-vs. , 



Statistic II— This statistic relates the forecast error to the 
actual change in employment over the forecast period and is 
computed as follows: 



Statistic II = 



Total Forecast - Total Actual 
Total Actual - Total Original 



Similar to Statistic I, this indicator allows canceling of inter- 
nal errors and considers only the total employment of the 
X employer or other aggregation. In the case of an incorrect 

no-change forecast. Statistic II is always 1,0 because the 
total forecast equals total original employment. 

A complete explanation, including the derivation, limits, special cases, and 
interpretations of each of these statistics, is presented in Appendix F. 

Our resurvey of employers in Oklahoma indicated that the forecast of 
total employment statewide was understated. The three statistics described 
above were utilized to evaluate the overall accuracy of employer forecasts. 
The results of these analyses indicated that: • 

Forecast accuracy varied widely by firm. 

Type of forecast and emplojrment size did not substantially 
affect accuracy. 

Forecast accuracy varied by industry. 

Accuracy of the occupation forecast varied by region. 

Clustering did not improve accuracy substantially. 

Forecast figures for "All Remaining Employees" did not 
adversely affect the accuracy of the total forecast. 

These analyses and resultant findings are presented in the succeeding sections. 

(1) Forecast Accuracy Varied Widely Among Firms 

The accuracy of the manpower demand forecast made by the 193 
employers in Oklahoma participating in the resurvey varied widely. 
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£3chiblt VIII, following this page, presents the distribution of employers 
for each error statistic. The complete distribution by region for each 
statistic is included in Appendix G. A sample printout for a firm is also 
included in this appendix. 

As shown in Exhibit VIII, the range of U varies from 0 to over 
2. 0000. The distribution of forecasts within this range is as follows: 

. Some X5, or approximately 7.8 percent, of the forecasts 
were perfect. Given the characteristics of the U Statistic, 
this means that the individual forecasts for each of the occu- 
pations were perfect. 

A total of 17, or approximately 8. 8 percent, of the forecasts 
had a U value between .0001 - . 5999. 

Some 43, or about 22.2 percent, of the forecasts showed a 
U of from . 6000 - . 9999. 

A total of 72, or about 36. 7 percent, of the forecapis had a 
U value of 1.0000. The large number of employers having 
a unit value is due to the high incidence of incorrect no-change 
forecasts. 

Some 46, or 24. 5 percent, of the forecasts had a U value of 
1. 0001 or over. 

This analysis of the U Statistic values indicates that over 60 percent of 
the forecasts did not decrease the inaccuracy which would have occurred 
had a simple, no-change extrapolation been used. More importantly, 
many of these forecasts were more inaccurate. Therefore, a more 
accurate forecast wo\ild have been available if a simple, no-change extra- 
polation had been utilized. 

As noted earlier. Statistic I relates the forecast error to total actual 
employment at the time of resurvey. This tends to narrow the range of 
the statistic because of the relatively large base. Even so. the Statistic I 
values range from over -. 500 to over +. 500. The distribution of fore- 
casts within this range is described subsequently. 
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Some 26, or approximately 13. 5 percent, of the forecasts 
were perfect. The majority of these were no-change fore- 
casts. 

Some 87, or approximately 45. 1 percent, of the forecasts 
were low. 

The remaining 80 employer forecasts, or 41.4 percent, were 
high. 

Ignoring plus and minus signs, the forecast error, when compared to 
act\Mil employment resulted in: 

Some 74, or 38. 3 percent, of the forecasts had a Statistic I 
value from .001 - . 100. 

Some 36, or approximately 18.7 percent, of the forecasts had 
a Statistic I value of from .101 - .200. 

Another 36. or approximately 18. 7 percent, of the forecasts 
had a Statistic I value between .201 - . 500. 

The remaining 21, or 10. 9 percent, of the forecasts had a 
Statistic I value of over . 500. 

Thus, nearly 30 percent of the firms made forecast errors of over 20 
percent when compared to total actual employment. 

Statistic II relates the error in the forecast to the actual change 
total employment over the forecast period. Thus, the range of values for 
Statistic II is usually high when comjpared to Statistic I because of the 
much smaller base. Obviously, th;j same number of employers made a 
perfect forecast in the Statistic II as in Statistic I. Ignoring the signs, 
the range of forecast values is as follows. 

*• 

Some 14, or approximately 7.4 percent, of the forecasts had 
a Statistic II value between .001 - .400. 

Some 26, or 13. 5 percent, of the forecasts had a Statistic II 
value between . 401 - . 800. 
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A total of 85» or 44. 1 percent, of the forecasts had a value 
between . 801 - 1.000. Similar to the U Statistic, the high 
incidence of unit values is due to the fact that the value for 
this statistic is one. if there is any error in a no-change 
forecast. Thus, an error of one employee or 400 employees 
results in a unit value* 

The remaining 42, or 21.8 percent, of the forecasts had a 
Statistic II value of over 1. 000. 

Thus, over half of the employers had a forecast error equal to or greater 
than the actual change in employment. 

(2) Type Of Forecast And Employment Size Did Not Substantially Affect 
Forecast Accuracy 

« 

Eighty -two, or approximately 40 percent, of the employers partici- 
pating in the resurvey had originally made "no-change" forecasts, i. e. , 
they predicted no change in total employment or shifts of employment 
among occupations. No-change forecasts are difficiilt to evaluate. For 
example, they can represent the informed judgment of the employer or, 
as discussed later, can indicate an inability or uniwillingness to forecast. 

As noted earlier, for a no-change forecast the U Statistic values 
are either 1.0 or 0. addition, the Statistic 11 value for an incorrect 
no-change forecast is 1.0. More importantly, it had been hypothesized 
that smaller companies cannot forecast accurately and that the occupational 
codes do not fit in small companies when workers often perform a large 
number of varied tasks. Consequently, it was decided to evaluate the 
impact of type of forecast and employment size on forecast accuracy. 

Exhibit IX, following this page, presents the forecast statistics by 
type of forecast and size of employment. Appendix H contains the sum- 
mary source data for this array. The U Statistic value for a particular . 
employer is computed using the predicted and actual change for each 
occupation . The computation of the forecast error for Statistics. I and II 
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uses the totals for an employer, thus allowing some offsetting of errors 
in the projections for individual occupations. In order to prevent addi- 
tional offsetting errors » an average value for U, Statistic I, and Statis«- 
tic II was computed using the values for all employers in each of the six 
categories. The averages for Statistics I and II were computed using 
absolute values, i.e., ignoring the signs. 

The average error statistics for all firms are: 

0. 996St for the U Statistic 

0. 26879 for Statistic! * c- ' 

1 . 241 75 for StaUstic II 

As, Exhibit EX shows* the averages of the employers in each of the six 
categories are sinailar to the average for all employers, with minor 
exceptions. -i^ The slightly lower values of U for employers who made 
"no-chang9** forecasts reflect the fact that the upper limit of U for a 
no-change forecast is 1.0000, regardless of the magnitude of the fore- 
cast error. Similarly, Statistic II tends toward the unit for incorrect 
no-change forecasts. These data also indicate that the average value for 
Statistic I for small firms is higher than the overall average regardless 
of the type of forecast. This is probably due to the fact that forecast 
errors are related to a smaller base in smaU firms than in large firms. 

Exhibit IX also presents the three statistics computed using the 
number of original, forecast, and actual employees in each category and 
statewide. This ^ows additional errors to be offset among the firms in 
each category. Consequently, the statistics reflect a higher degre."^ of 
accuracy at this level of aggregation. 



jyt Hie results of a multiple tegtestion aaaljnds cond u cted using die EDA BIOMED Stepwise Miltiple RegiesBion 
package indicated that the ability of an employer to forecast accurately was not associated with type foxe» 
cast, number of emplciyees, or auxiber of ocoqiatioss. 
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(35 Some Variation Occurs In Forecast Accuracy By Industry 

Exhibit X, following this page, displays the values for U, Statistic 
I, and Statistic II by industry. Similar to the preceding array by type of 
forecast and employment size, these values are the averages of all 
employers in a particular industry. Values of Statistic I and Statistic II 
were computed using absolute values, i.e., ignoring the signs. The 
range of values is: 

. U Statistic ranges from 0.85152 to 1. 17823. The average for 
all industries is 0.99661. 

Statistic I ranges from 0. 13288 to 0.91375. The average for all 
industries is 0. 26879. 

Statistic II ranges from 0.82835 to 1.86111. The average for 
all industries is 1.24175. 

In our judgment, the statistics are relatively high, indicating poor fore- 
cast accuracy. However, the statistics do indicate that the Finance, Insur- 
ance, and Real Estate Industry and the Medical and Health Service Industry 
forecasts are more accurate than average forecasts of employers In Con- 
struction and Durable Goods Manufacturing Industries. 

(4) The Accuracy Of The OTIS Occupational Forecast Varied By Region 

The previous analyses were concerned with the ability of an employer 
or group of employers to accurately forecast manpower demand by occu- 
pation and in total. As described in Chapter II, the data produced and 
utilized by OTIS are regional summaries of net manpower requirements 
\ by occupation and /or occupational cluster. Thus, the accuracy of the 
net requirements forecast by occupation is a function of the accuracy of 
the demand forecast. Consequently, the accuracy of the forecast for 
manpower demand by occupation must be determined. 
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EXHBIT X 



Economic Development Acbnioistxatioii 

BEST copy ■.-'■.;:.r;LE 



SUMMARY Of OKLAHOMA FORECASTS 
BY INDUSTRY 





Number of 


Number of Emolovees 


Aveiaae Statistics 


Industxy 


Employers 


Oriainstl 


Forecast 


Actual 


U 


I 


II 


Ccnstmction 


o 


198 


231 


251 


1.04066 


0.80963 


1.86111 


Disable Goods 
Masufacttiriag 


23 


6,189 


7,167 


8,261 


1.17823 


0.24389 


1. 15328 


Finance » Instrnmce^ 
and Real Estate 


31 


2,645 


2,812 


2,860 


0.85152 


0.13288 


1. 19629 


Medical and Health 
Services 


12 


2,804*^ 


2,964 


3,363 


0.89481 


0.15946 


0.82835 


Mining 


15 


1.014 


1,008 


915 


0.87052 


0.91375 


1. 33384 


Nonduiable Goods 
Manufacturing 


18 


4,544 


4,789 


4,519 


1.13508 


0.17968 


1.41440 


ftablic Utilities 


23 


8,369 


8,693 


8,951 


1.13887 


0. 14471 


0.97322 


Service 


12 


401 


430 


389 


0.99336 


0.54991 


1.68518 


Trade 


53 


7.494 


7.879 




0.94838 


0.15511 


1.28048 


Total 


193 


33,658 


35,973 


37,315 




m 


m 


Average 










0.99661 


0.26879 


1.24175 



As part of our analyses* the occupational projections of each 
employer in a region were totaled to obtain regional summaries of man- 
power demand by occupation. A sample summary is included in Appen- 
dix H. The accuracy of these summary data was evaluated using the same 
thi.ee error statistics used to evaluate employer forecasts. Eschibit XI, 
following this page, displays the error statistics for the occupational sum- 
mary in each region. Errors among employers for a specific occupation 
are netted out before any calculations are made. These statistics ^ere 
computed in the same way as the statistics for an individual employer. 

The U Statistic was computed using the predicted and actual 
changes for each occupation in the summary. 

Statistic I was computed using the totals for all of the occupa- 
tions in the region, thereby allowing some offsetting errors 
among occupations to net out. 

Statistic II was also computed using the totals for all occupa- 
tions, thereby allowing some errors to be offset. 

As indicated in the exhibit, the statistics vary in value by region. 
Excluding regions 1 and 11 because they have relatively s^nall numbers 
of employees and extremely large error statistics, the range and aver- 
age for each of the three statistics are: 

The U Statistic ranges in value from 0.6727 to 1. 1492. The 
average U for the remaining nine regions is 0. 9393. 

Statistic I ranges in value from 0. 0177 to 0. 1760. The average, 
computed using absolute values, is 0. 0641. 

Statistic II ranges in value from 0.0848 to 0.6731. The average 
computed using absolute values, is 0. 5288. 

The regional performance, varies by statistic. For the U Statistic, regions 
2 and 4 made the best forecast and regions 3 and 5 the worst. Based on 
Statistic I values, regions 3 and 9 made the best forecast and regions 4 
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fV\\jBlt EXHIBIT XI 



Economic Development Admioistxation 
OKLAHOMA OCCUPATIONAL FORECASTS BY REGION 





Number of Employees 


Statistics 




Orieinal 


ForecaK 


Actual 


U 


1 


II 


1 


519 


568 


524 


1. 1498 


.0840 


8.8000 


2 


1,965 


2,056 


2,210 


0.6727 


-.0697 


-0.6286 


3 


574 


753 


739 


1. 1492 


.0189 


0.0848 


4 


1,204 


1,353 


1,642 


0.8216 


-.1760 


•0.6598 


S 


738 


814 


789 


1. 1109 


.0317 


0.4902 


6 


3,435 


3,556 


3,711 


0,8240 


-.1027 


-0.6558 


7 


1,851 


1,969 


2,212 


0,9583 


1099 


-0,6731 


8 


16 « 150 


17,092 


16,715 


1.0334 


.0226 


0.6673 


9 


526 


554 


564 


0.9107 


n,0177 


-0.2632 


10 


245 


249 


256 


0.9725 


-.0273 


-0.6364 


11 


487 


565 


519 


4.4795 


.0886 


1.4375 


Total 


33,638 


35,973 


37,315 








Average 
(9 Regions) 








0.9393 


.0641 


0.5288 



and 7 the worst. In addition, region 8, the largest region in terms of 
employnient, had an excellent Statistic I value of approximately 2 per- 
cent* For Statistic II» regions 3 and 9 made the best forecast and regions 
7 and 8 the worst. 

(5) Combining Occupational Totals Did Not Significantly Improve The 
Accuracy Of The Test Clusters 

The preceding section discussed the accuracy of the regional sum- 
maries of manpower demand by occupation. The basic finding was that 
the occupational forecasts were often inaccurate. However* OTIS groups 
various occupations into vocational education training clusters and pub- 
lishes summary data by cluster. This procedure combines occupational 
totals, thereby providing opportunity to offset or average errors in indi- 
vidual occupations. Therefore, to fully understand the entire forecasting 
problem, an examination of the impact of clustering on forecast accuracy 
was required. 

Based on an examination of the OTIS Cycle Five Report, EDA 
decided to examine six clusters in four regions and on a statewide basis. 
Data from the resurvey were clustered and analyzed using the three error 
statistics. Exhibit XII, following this page, presents the results of this 
analysis. In general, the forecast accuracy was not substantially improved. 
The principal reason for this lack of major improvement is that many of 
the forecasts in a particular cluster tended to be either low or high, rather 
than a combination of some high forecasts with some low forecasts. Con- 
sequently, errors for individual occupations were averaged as a result 
of clustering rather than reduced substantially by offsetting errors in the 
occupational forecasts. 
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EXHIBIT XII 



Economic Developmeat Administsatloa 

FORECAST ACCURACY BY CLUSTER 
m SELECTED REGIONS IN OKLAHOMA 



Cluster 


KegiOQ 


Number of Employees 


Statistics 


Orlidnal 


Fotecast 


Actual 


U 


I 




Oiirpefiitsry 


4 


16 


20 


19 


0.332 


0.053 


0. 333 




6 


50 


55 


55 


0.686 


0.000 


0.000 




7 








1 141 


0 0S6 


2 000 




8 










W* X«7D 


in ooo 




State 


342 


S79 


$53 


1.459 


0.074 


2.364 


nncticai (Vocational) Nuxsmg 




tmmm 




— 


. mm 


— 




(Not a Cluster) 


6* 


mm 


mm 




^m 


— 


— — 




^* 
8 


6 


9 


7 


2.000 


0.285 


2.000 




^tate 


218 


252 


244 


0.531 


0.033 


0.308 


Electricity /Electtcoiic Tedmolog^/Electio* 


4 




2 


4o 


0.978 


•0.956 


•0.978 


mecbajiical Tecfeiclogy 


6 




o 


1 

A 


1 749 


7 000 


1.750 




7 


4 


4 


4 




0»OOO 


0*000 




8 




1? 








0 000 




State 


55 


60 


87 


0.872 


-0.310 


-0.844 


■ " " " .- . - 

Machiike Shop/ Machine Tool Operation 


4 


8 


12 


10 


1.000 


0.200 


1.000 




6 


189 


216 


234 


1.135 


-0.077 


0.400" 




7 


12 


14 


14 


O.00O 


0.000 


0.000 




8 


110 


125 


156 


0.603 


-0.198 


.0.674 




State 


373 


426 


470 


0.848 


-0.094 


-0.4S4 


AccDuntinff and Comtsutinff 


4 


SO 


S3 


57 


1.118 


-0.070 


-0.571 




6 


551 


570 


645 


0.907 


'0.116 


-0,798 




7 


199 


211 


181 


1.265 


0.166 


1.667 




8 


808 


865 


876 


0.757 




-0. 162 




State 


1,876 


1,974 


2,079 


0.812 


•0.051 


-0.517 


TnmspofCation/Tmck Driver 


4 


72 


88 


104 


0.826 


-0.154 


-0.500 




6 


696 


695 


819 


0,907 


-0. 151 


-1.008 




7 


45 


45 


47 


0.906 


-0.043 


-1.000 




8 


37 


46 


65 


0.680 


-0.292 


-0.679 




State 


1,882 


2.029 


2,188 


0.572 


^.073 


-0.?20 



BEST con ;;j;;.iA3ii 



♦ Refusvey data not av<iUable 



(6) The Forecast For The "All Remaining Employees" Category Did 
Not Affect The Overall Forecast Adversely 

The survey instruments used to collect the OTIS demand data con- 
tain a "catch-all" occupational category called "All Remaining Employees." 
The use of this category simplified data collection and preparation. Since 
over 30 percent of total manpower demand is reported in this category, 
an analysis of the impact of the "All Remaining Employees" category on 
forecast accuracy is required to complete the forecast picture. 

Exhibit XIII, following this page, presents the results of our analysis 
of the effect on forecast accuracy of the "All Remaining Employees" cate- 
gory. This analysis is based on a comparison of Statistic I and II for total 
employment and adjusted total employment. The adjusted total was com- 
puted by subtracting "All Remaining Employees" from total employment. 
As indicated in the exhibit, the adjusted total was: 

More accurate in three regions 
Less accurate in six regions 
Approximately the same in two regions 

The statewide totals were also approximately equal. Thus, the inclusion 
of the "catch-all" category did not affect forecast accuracy adversely. 

3, THE FORECAST OF MANPOWER DEMAND MADE BY EMPLOYERS 

PARTICIPATING IN THE KENTUCKY RESURVEY WAS OVERESTIMATED 

This section presents our analysis of the accuracy of the employer and 
occupational forecasts in Kentucky. The analyses, error statistics, and calcu- 
lations are similar to the procedures utilized to assess the OTIS data in Okla- 
homa. In contrast to the resmrvey of about 200 employers in Oklahoma at the 
end of an approximate two-year forecast period, the resurvey in Kentucky was 
undertaken at the end of a one-year forecast period,^ and included 301 firms. 
The resurvey methodology, including sample selection and survey procedures, 
is described in Appendix E. The results of a comparison of forecast and actual 
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EXHmrr xm 



^^r)^ ^!^(^^^^^ Gcottomic Development Adminiitrotion 

ALL REMAINING EMPLOYMENT 



FOR OKLAHOMA 



Region 


CatestPsv 


Number Of Qtnployt 




Statktics 


OriRinal 


{breeatC 


Actual 


I 


n 


1 


Au Remaining 


144 


166 




0.1857 


-6.5000 




Total 


519 


568 


524 


0.0840 


8.800O 




Adjusted Total 


375 


402 


384 


0.0469 


2.0000 




All Remaining 


594 


642 


718 


-0. 1058 


-0,6129 




Total 


1,965 


2,056 


2,210 


-0.0697 


-0.6286 




Adjusted Total 


l»371 


1,414 


1,492 


-O.0S23 


-0.6446 


3 


AU Retnatxung 


122 


134 


137 


-0.0219 


•0.2000 




Total 


574 


753 


739 


0.0189 


0.084S 




Adjusted Total 


452 


619 


602 


0.0283 


0. 1133 


4 


All Remaining 


276 


304 


301 


0.0100 


0.1200 




Total 


1,204 


1,353 


1,642 


-0. 1760 


-0.6598 




Adjusted Total 

• 


928 


1,049 


1,341 


-0.2177 


-O.707O 


5 


All Remaining 


229 


260 


246 


0.0569 


0.8235 




Total 


738 




789 


0.0317 


0.4902 




Adjusted Total 


509 


* 554 


543 


0.0202 


0.3235 


0 


All Remaining 


3,435 


3,556 


3,711 


-0.0418 


-0.5616 




Total 


9,399 


10.000 


11,145 


-0.1Q^7 


•0,655fi^ 




Adjusted Total 


5,964 


6,444 


7,434 


•0.1332 


•0,6735 


7 


All Remaining 


373 


389 


380 


-0.4941 


-0,9596 




Total 


1,851 


1,969 


2,212 


-0. 1099 


-0.6731 




Adjusted Total 


1,478 


1,580 


l,822i 


-0.1375 


•0.7119 


8 


All Remaining 


5,896 


6,074 


5,863 


0.0360 


-6.3939 




Total 


16,150 


17,092 


16,715 


0.0236 


0.6673 




Adjusted Total 


10.254 


11,018 


10,852 


0.0153 


0.2776 




All Remaining 


140 


1S2 


169 


-0.1006 


•0.5862 




Total 


526 


554 


564 


-0.0177 


•0.2632 




Adjusted Total 


386 


402 


395 


-0.0177 


0.7778 


10 


All Remaining 


35 


36 


70 


-0.4857 


-0.9714 




Total 


245 


249 


256 


-O.0273 


-0.6364 




Adjusted Total 


210 


213 


186 


0,1452 


-1. 1250 


11 


All Remaining ' 


51 


51 


49 


0.0408 


-1.0000 




Total 


487 


565 


519 


0.0886 


1.4375 




Adjusted Total 


436 


514 


■470 


0.0936 


1.2941 


Total 


All Rexxtaining 


11,295 


11,764 


12,173 


-O.0336 


. -0.4658 


All Regiow 


Total ; 


33,658 


35,973 


37,315 


-0.0360 


1 -0.3670 




Adjusted Total 
....... — , ,„■ I 


22,363 


24,209 


25,142 


-O.0371 


''-0.33S7 



1,; <» 
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employment indicated that the forecast of demand was overestimated by 1. 100 
positions. This overstatement represents an error of 2 percent when compared 
- to actual employment and 98 percent when related to actual change in employ- 
ment. During the forecast period, manufacturing employment in Kentucky 
» increased by approximately 6. 5 percent.-^ 

Our analysis of the Kentucky resurvey data indicated that manpower demand 
was overstated. Specifically^ the results of our analysis indicate that: 

Forecast accuracy also varied widely among employers. 

Forecast accuracy was not influenced substantially by type 
of forecast or employment size. 

Significant variations in accuracy by industry did not occur. 

Accuracy of the occupational forecast varied by region. 

Clustering did not improve forecast accuracy significantly. 

These findings are discussed in the following sections. 

(1) Forecast Accuracy In Kentucky Also Varied Substantially Among 
Employers 

Forecast accuracy among the 301 manufacturing employers in Ken- 
tucky participating in our resurvey also varied widely. Exhibit XIV, follow- 
ing this page, presents the distribution of employers for each of the three 
error statistics. The complete distribution by region for each statistic 
is included in Appendix G. A sample printout for a manufacturing firm 
in Kentucky also is included in this appendix. 

As shown in Exhibit XIV, the range of the U Statistic varies from 0, 
or a perfect forecast, to over 2. 0000. The distribution of forecasts within 
this range is: ^ 



lasured employment figures from Kentucky Department of Labor. 
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Some 33. or approximately 11 percent, of the forecasts were 
perfect forecasts. As noted earlier, a perfect forecast requires 
the forecast for each individual occupation to be correct. 

A further 39, or approximately 13 percent, of the forecasts 
had a U value between .0001 - .9999. 

Some 137, or 45. 5 percent, of the forecasts had a U value of 
1. 0000. The high incidence of firms with a U value of 1. 0000 
is caused by the large number of incorrect no-change forecasts. 
As noted earlier, an error in a no-change forecast results in 
a unit value for the statistic, regardless of magnitude. 

A total of 92, or slightly over 30 percent, of the forecasts had 
a U value of i. 0001 or over. 

These results indicate that, in over 75 percent of the forecasts, the error 
was either equal to or greater than the error associated with a simple 
no-c4iange forecast. In other words, in the majority of the cases, a 
simple no- change extrapolation of current employment at the time the 
survey was taken would have yielded results equal to or better than those 
obtained from the forecast. 

The Statistic I values range from over -. 500 to over +. 500. The 
forecasts are distributed fairly evenly throughout this range. Specifically, 
of the 301 forecasts: 

\ 

Some 42, or 14 percent, of the total were perfect forecasts. 
The majority of these were no-change forecasts. A higher 
number of perfect forecasts occur in this statistic than in the 
U Statistic because only the totals and not all of the occupa- 
tional forecasts must be accurate. 

A group of 115, or approximately 38.2 percent, forecast man- 
power demand below actual. 

The remaining 144 employers, or 48 percent, forecast a higher 
demand than was observed. 

Using the absolute values, the range of forecast errors compared 
to actual employment is: 
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Some 121, or over- 40 percent, of the forecasts had a Statis- 
tic I value of from . 001 to . 100. 

Some 50, or approximately 16.6 percent, of the total had a 
Statistic I value of from .101 to . 200. 

A further 65, or approximately 21.6 percent, of the total had 
a Statistic I value of Trom . 201 to . 500. 

The remaining 23, or approximately 7.6 percent, of the fore- 
casts had a Statistic I value of over . 500. 

Thus, over 29 percent of the employers made forecast errors of over 20 
percent when compared to total actual employment. 

The range of Statistic II varies from over -1.000 to over +1.000. 
The range of this statistic is greater than the range for Statistic I because 
the same forecast error is applied to actual change in employment rather 
than total actual emplo3rment. Fourteen percent, or 42 employers, made 
perfect forecasts. Ignoring the signs, the range of forecast values is: 

Some 18, or 6 percent, of the forecasts had a Statistic II 
value of from . 001 to . 400. 

Some 2y, or about 9. 5 percent, of the total had a Statistic II 
value of from . 401 to . 800. 

A total of 128, or nearly 43 percent, of the forecasts had a 
Statistic II value between . 801 and 1. 000. The large number 
of employers in this range is caused by .the high incidence of 
incorrect no-change forecasts, which result in a unit value. 

The final 84, or nearly 28 percent, of the forecasts had a 
Statistic II value of over 1. 000. 

These data indicate that over half of the firms made a forecast error equal 
to or greater than the actual change in employment over the forecast period. 
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(2) Forecast Accuracy Was Not Affected Substantially By Typg Of 
Forecast Or Employment Size 

Nearly one-half of all of the forecasts in the initial OTIS survey 
were no-change forecasts. As noted earlier, it is difficult to identify 
the reason for a no-change forecast. More importantly, as discussed 
later, many no-change forecasts in Kentucky were actually no for«>casts. 

Exhibit XV, following this page, presents the forecast statistics by 
type of forecast and employment size. Appendix H contains the summary 
source data for this array. The U value for. a particular employer is com 
puted using both the predicted and actual changes for each occupation. • 
The computation of the forecast error for Statistics I and II u^es the 
totals for an employer, thus allowing offsetting of errors among the 
occupations. In order. to prevent additional offsets, an average value for 
U, Statistic I, and Statistic II was computed using the values for all employ- 
ers in each of the six categories. The averages for Statistics I and II were 
computed using absolute values. The average error statistics for all 
employers is: 

1.08004 for the U Statistic 
0.30372 for Statistic I 
1.88408 for Statistic II 

A comparison of the statistics in each category with the averages 
indicates substantial departures. In our judgment, however, these depar- 
tures reflect the characteristics of the error statistics and do not indicate 
differing abilities to forecast among the groups.!/ For example, the much 
lower values of U for no-change forecasts reflect the fact that the upper 
limit of U for a -no-change forecast is 1. 0, Thus, with an infinite upper 
limit possible in change forecasts, the average is higher. Additionally, 



1/ Hie resulti of a multiple regxestioa analysis coaducted using tiie ££>A BIOMED Stepwise Multiple Regressiou 
package indicated that the ability of an employer to foiecast accurately was not associated with type of foK- 
cast, number of emplayees, or number of occupations. 
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the statistics do not indicate that accuracy varies by size of employment. 
However^ they do indicate that Statistics I and II are higher for small 
firms. In our judgment, this is due to applying a forecast --ror to a 
smaller base in both cases, e.g. , the actual employment and probably 
the actual changes are smaller in small firms than in large firms. 

Exhibit XV also presents the three statistics computed using the 
number of original, forecast, and actual employees ?n each category and 
statewide. This allows additional errors to be offset among the firms in 
each category. However, with the exception of Statistic I. the statistics 
are still relatively high. 

(3) Forecast Statistics Do Not Indicate Major Industry Differences 

Exhibit XVI. following this page, displays the average value for U, 
Statistic I. and Statistic II of the employers in each industry classification 
to the values for Statistics I and II. computed using the absolute values 
for each employer. The range of the average values is: 

U Statistic ranges in value from 0. 061953 to 2. 72777. The 
average for all industries is 1 . 08004. 

Statistic I ranges in value from 0. 00870 to 0. 65428. The aver- 
age for all industries is 0. 30372. 

Statistic II ranges in value from 0. 60000 to 7. 50000. The aver 
age for all industries is 1.88408. 

Most of the statistics are relatively high, indicating inaccurate forecasts 
by industry. Mc: ^ importantly, these averages do not indicate a clearcut 
example of one industry producing better forecasts than others for all 
three statistics. For example, the best forecast in U. Statistic I. and 
Statistic l\» respectively, are the Leather and Leather Product Industries. 
Petroleum Refining and Coal Product, and the Musical Instruments Indus- 
tries. The worst industries were the Nonferrous Rolling and Drawing/ 
Miscellaneous Primary Metal Products. Tobacco, and Stone Products 
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BEST COPY AVAILABLE 



E»iIBlT XVI 
Economic Development Admiaiscxation 



SUMKIAI^V OF KENTUCKY FORECASTS 
BY MANUFACTURINC. INDUSTRY 





^.*tunS£9 of 


^fumbc^ of Enjrfoveet 


Avefiae Ststiitics 


Ntamifactixiins tmfutnv 


Em»lQt»aL_ 


Original 


Forecast 


Actual 


U 


t 


n 




97 


2X,4S5 


22,763 


21,881 


1.2509S 


0. 31833 


2.01965 




6 


1,093 


1,099 


1,123 


1.00425 


0. 32323 


i.asooD 


Dairy ftoducts 




416 


434 


493 


0*62241 


0.11623 


1.56771 


Canned aod l^yetved Fniltv, Vcgetableti and Sc»tfood 


3 


sa« 


635 


475 


1.71799 


0.21418 


4.77419 


Grain Mill Ftoductt» Stigar» Confectioiury^ and MIk* 


9 


S64 


572 


570 


U 17702 


0. 10006 


1.22222 


Foodt 
















Bakery Pioductt 


I 






203 


I.OQOOO 


0. 01478 


1.00000 


Bevemge {¥pducl» 


16 


3»27S 


3,2S4 


3,241 


U0S617 


0.21357 


2.11035 


Te^cco Snduftry 


D 


3 709 


3,SS2 


3,634 


0.84779 


0.65428 


0.92394 


Textile MUl Ptoduct* 


5 


1,654 


1,770 






U. lU^ld 




Apparel and Other Textile Ptoducts Induitries 


l& 






5 939 


0. 9S403 


0. 1S759 


2. 16494 


Lumber and Wood ftpducts 


21 


1, 338 


1,450 


1,231 


0. 98021 


0.09231 


1.93487 


Furniture and Fhctxm Indumy 


IS 


1,722 


1.754 


1,615 


0.88141 


0. 32003 


0.65384 


Ccowxted operand PUperboard Ptoductt 


8 


1,466 


1,512 


1,SJ6 


1.16238 


0.05442 


2.75173 


SMntlfig and ^bliihfns Induftries 


«o 


2,851 


2,898 


2,731 


0.83729 


0.47891 


1.05083 


loduArial OiemicaU Induftxy 


2 


290 


29S 


323 


1.121S8 


0. 16872 


2.96875 


naKio$ and Synthetic Fibcn indx^stiy 


6 


3,536 


3,566 


3»63S 


a$8970 


0.13292 


0*91116 


Soapp, Cleaneti, and Toilet Pt«panitlons 


2 


18 


20 


17 


1.00000 


0.36905 


5.50000 


Ftiinti and AUIed Ptoductv^ Agrleultunl Cben)icalt, and 


7 


2X5 


227 


224 


1.03546 


0.08060 


0.73809 


MIficeUaneouft Chemical FVcKhicta 
















Beti«leii»ii Heflning and Coal hvKhict Indnxtries 


1 


116 


116 


115 


1,00000 


0. 00870 


X. 00000 


Rubber TIrta and TVzbct asd Fabtieated Hubber Pfeoducta 


2 


93 


Ol 






0.07198 


1.00000 


MiiceUaseoua I^Uitic ftoducts Indumy 


10 


1^042 


1.173 


U040 


X.?9846 


0. 15X75 


3.65036 


icadier and Uather IVoducta Inckutriee 


2 


U7 


123 


^ 124 


0*61953 


0.05000 


5.00000 




1 


199 


199 


278 


1.00000 


0.284X7 


x.ooooo 


n«t CUfp, daapvate* and C2aai .^Voducta 


1 


91 


91 


95 


uooooo 


0.012X1 


x.ooooo 


Cement, Stntecnial Clay, fisctery, Ptaater 


It 


257 


284 


284 


O.o7aro7 


U. 214 A] 


U. 00050 


Stone ¥^!odQct» and MitceUaneow Mineral Products 


I 


48 


61 


46 


t.50000 


0.32609 


7.50000 


InduftSfiet 


\ 














ftlait Ftoaoft^ and Baaic Steel Products Isduittiex 


4 


6,076 


5,993 


6,043 


2« 21838 


0.07670 


3. 12570 


Iron and Steel and lsto»jle«oti« Foimdrlaa 


31 


493 


508 


610 


1.00931 


0.17883 


0.72222 


NdBfanoui RoUJng and Djnwtnac/MiiceUaneow PHmajjy 




984 


1»016 


1,020 


2.72777 


0.1454X 


3.60000 


Metal A»ducta 


\ 
\ 














I^^cal Sttitmmenta, Toy«» Spotting Goodly and Other 
Selected ftoduds 




137 


141 


154 


0.80306 


0.08044 


0.60000 














Total 




59,467 


61,692 


60,592 








Avcrajc 


V ■ 




m 




1 1.08004 


0. 30372 


1.88408 



\ 
\ 

\ 

\ 

\ 



and Miscellaneous Mineral Products Industries. More importantly, the 
large industries group with the most employers and employees had rela- 
tively high values for all three statistics, including Metal Working, Blast 
N^urnaces and Basic Steel Products, and Apparel and Other Textile Products. 

(4) The Accuracy Of The Kentucky OTIS Forecasts Varied By Region 

The previous analyses considered the ability of an employer or 
various groups of employers to forecast manpower demand accurately. 
However, OTIS actually produces and uses regional summaries of net 
manpower demand by occupational cluster. Manpower requirements are 
then determined by interfacing manpower supply and demand data by occu- 
pation. Consequently, to understand the actual utilization of the subsystem, 
an assessment of the accuracy of the forecasts of manpower demand by 
occupation is necessary. 

Regional summaries of manpower demand by occupation were com- 
piled from our resurvey data. A sample summary is included in Appendix 
H. The accuracy of the regional summaries was assessed using the same 
three statistics used to evaluate employer forecasts. The regional data 
were computed in the same manner as the data for an individual employer. 

The U Statistic was computed using predicted and actual change 
for each occupation. 

Statistic I and Statistic II were computed using the totals for 
all occupations. 

Thus, U Statistic allows only net outs among firms for a specific occupa- 
tion. However, Statistic I and Statistic II allow net outs among employers 

and among occupations before any calculations are made. 

* 

Exhibit XVII, following this page, presents the error statistics for 
each regional summary. The range and average of each statistic are: 
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EXHIBIT XVII 




Economic Developemeat Administxation 
KENTUCKY OCCUPATIONAL 



FORECASTS BY REGION 





Number of Emplovees 


Statistics 








u 


I 


II 


1 








1 00S42 


0.09418 


-1.30769 


2 








0 99588 


0.09267 


-1.22000 








/ 7*r 


1.22450 


0.0S696 


-1,64179 


4 


C ADC 






0 94112 


-0.02309 


-0.24735 


5 


417 


455 


498 


0,94502 


-0.08635 


-0.53086 


6 


21,362 


21,950 


;£iy47^ 






3 42105 


7 




3,743 


3,643 


1.09780 


0.02745 


0.50S05 


8 


1,560 


1,681 


1,684 


0.94828 


-0.00178 


-0,02419 


9 


307 


307 


311 


1.00000 


-0.01286 


-1.00000 


10 


4,862 


4,893 


4,793 


1.09996 


0.02086 


-1.44928 


14 


603 


652 


740 


1.03912 


-0.11892 


-0.64234 


IS 


12.198 


12.691 


12,576 


0.95930 


0.00914 


0.30423 


Total 


59,467 


ei,692 


60,592 








Average 


m 






1.01572 


0.04712 


1.02449 



The U StatisUc ranges from a low of 0. 93222 In region 6 to a 
high of 1. 22450 in region 3. The average of all the regions 
is 1.01572. 

Statistic I ranges from a low of 0. 00178 in region 8 to a high 
of 0. 11892 in region 14. The average value for all regions is 
0.04712. 

Statistic II ranges from a low of 0. 02419 in region 8 to a high 
of 3. 42105 in region 6. The average value is 1.02449. 

The regional performance varies by statistic. The U Statistic was high 
in all regions. However, considering Statistics I and 11, regions 8, 4, 
and 15 had relatively good forecasts. Conversely, regions 3, 14. and 1 
had relatively poor forecasts based on Statistics I and II values. 

(5) Combining The Occupation Data Into Clusters D id Not Significantly 
Improve Forecast Accuracy 

As discussed in our earlier analysis of the Oklahoma demand data, 
the Project Monitoring Committee decided to test the effect on forecast 
accuracy of combining occupational data into clusters. Six clusters were 
selected by EDA for testing in four regions and also statewide. The Com- 
mittee also wanted to test the potential impact of clustering in Kentucky. 
Since the Kentucky OTIS data are not published and the clusters not avaU- 
able. the Oklahoma clustering scheme was utilized to test the Kentucky 
data. The occupational clusters drawn up in Kentucky were derived from 
an analysis of the Oklahoma OTIS Cycle Five Report and the Office of Edu 
cation instructional program classifications. Once the appropriate DOT 
codes were selected, the corresponding BLS codes were matched and the 
clusters developed. 

These data were analyzed using the three basic error statistics. 
Exhibit XVIII. following this page, presents the results of this analysis. 
In general, forecast accuracy was not improved substantially. As was 
apparent in the case of the Oklahoma clustering data, the reason for this 
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. >\'i\*^^^ Ecosomic Development Administration 

EFFECT OF CLUSTERING 
IN KENTUCKY 





Number of Employees 


Statistics 


Cluster 


Region 




Foiecast 


Actual 


U 


I 


II 


Machine Shop/ Machine Tool 


3 


111 


114 


95 


1.03900 


0.20000 


1.18750 


Opemdon 


4 


595 


628 


604 


0.76223 


0.39700 


2.66600 


6 


. 427 


437 


S17 


0.95810 


-0.15470 


-0.88800 




IS 


56 


224 


144 


0.6S870 


0^^500 


0.90900 




State 


1,890 


2,244 


2,160 


0.92750 


0.38890 


0.31111 


Accronting and Computing 


3 


116 


117 


108 


1.00990 


0^08330 


1.12500 


4 


175 


177 


188 


1.02460 


-0.0S8S0 


-0.84615 




6 


396 


402 


392 


1.54596 


0.02550 


2.5000O 




IS 


71 


72 


81 


0.94921 


-0.11110 


-0.90dd0 




Stat» 


981 


1,073 


981 


4.35400 


0.09378 


10. 00000 


Ttonspoitation/Tmck Driver 


3 


104 


107 


97 


1.13137 


0.10309 


1.42850 


4 


410 


429 


321 


1.18000 


0.33640 


1.21348 




O 




662 


632 


2. 12800 


0.04740 


2,72700 










71 


1.24<^ 


-0. 12670 


-0.81818 




State 


1,614 


1,695 


1,585 


2.32000 


0.06940 


3,79310 


Caipentry 


3 


75 


81 


59 


1.17890 


0.37500 


1.37500 


4 


24 


24 


20 


1.00000 


0.20000 


1.00000 




o 




517 


483 


0.01766 


0.07039 


1.47826 




15 


203 


ZIZ 


ISO 




0 53620 


i 13846 




State 


965 


1,007 


876 


I. 15271 


0. 14954 


-1.47191 


Sheet Metal 


3 


45 


47 


52 


0.82764 


-0.09615 


-0.71428 




4 


76 


72 


83 


1.86547 


.0.13253 


-1.57142 




6 


331 


343 


388 


0.95289 


-0.11597 


-0.78947 




15 


357 


406 


411 


0.00587 


-0.01216 


-0.09259 




State 


1,305 


1,464 


1,420 


0.33100 


0,03100 


0.38261 


Composition, Makeup, and Ty pe- 


3* 


8 


8 


8 


0.00000 


0.00000 


0.00000 


setting/Printing 
















6 


287 


295 


286 


9.00000 


0.03146 


9.00000 




15 


55 


55 


48 


1.00000 


0. 14580 


l.OOOOO 




State 


363 


371 


S55 


2.00000 


0.04507 


-2.OO00O 
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lack of improvement is that many of the occupational forecasts for man- 
power demand in a particular cluster were either high or low. Conse- 
quently, errors for. individual occupations >vere "weraged rather than 
reduced by offsetting errors. 

4. THE INITIAL OTIS DEMAND DATA COLLECTION EFFORT IN KENTUCKY 
WAS A LARGE UNDERTAKING ] ^ 

The demand data collection effort in Kentucky^ involved the collection of 
employer forecasts through a census of all state manufacturing establishments. 
As already noted, data have been collected recently from 2, 175 employers. In 
addition, ongoing data collection is presently being directed toward more than 
8, 500 nonmanufacturing employers. 

The primary reasons for conducting a statewide census through personal 
interviews are to: 

Foster a rapport between industry and educational personnel, 
thereby: 

Improving response rates 

Acquiring assistance in the development of accurate 
occupational forecasts 

Facilitating counseling, placement, and curriculum 
modification efforts 

Enhancing placement prospects for vocational /technical 
graduates 

Stimulate interagency support and interest by cooperating to 
collect data 

Consequently, an evaluation of this approach must focus on the advantages of 
increased response rates and employer rapport over the disadvantages of 
increased costs and management problems. 
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(!) Increased Rapport With Employers Was Established In Many Instances 

Two expected results of the personal interview approach utilized by 
OTIS in Kentucky were the establishment of rapport with employers and 
improved data collection. The most recent personal inteiMews involved 
over 500 vocational education teachers and state agency personnel, and 
1, 551 man-days of effort. Thus, approximately one-half of a day, includ- 
ing travel time, was allowed for each interview and information was col- 
lected about 2, 175 firms. Clearly, this amount of time is adequate to 
complete a survey instrument and establish communications. Hence, 
rapport and a basis for future cooperation were probably established with 
many manufacturing employers. 

Nonetheless, the results of our resurvey indicate that the anticipated 
level of rapport was not realized because the data collection effort was 
not carried out properly in some instances and because some employers 
did not agree with the survey aims. For example, of the employers 
resurveyed, approximately 25 percent did not remember completing the 
survey. After discussing the survey with the resurvey interviewer: 

Fifteen percent of the employers stated that the personal visits 
involved only presenting the survey document and collecting it 
later on. 

Twenty-five percent of the employers said the survey instru- 
ment was received in the mail with a self-addressed envelop 
and no instructions. 

Fifteen percent of the employers said the survey instrument 
was presented and collected by vocational education students, 
but that no instructions were received. 

In addition, some employers stated that they (1) had prepared too many 
forms and that OTIS forms duplicated the ES documents, (2) believed 
the training of vocational education graduates was inadequate, and (3) 
could not hire vocational education graduates due to low turnover or 
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restrictions on outside hiring. Therefore, in many instances, the sxir- 
vey did not result in the expected employer rapport. More importantly, 
the lack of both personal contact and instructions to accompany the ques- 
tionnaires hampered the data collection effort in several instances. 

(2) Many Respondents In Kentucky Made No- Change Forecasts 

Exhibit Xrx, following this page, presents a summary of the fore- 
casts received in Kentucky. Over 50 percent of the employers participat- 
ing in the survey made no-change forecasts. The percentage of no-change 
forecasts ranged from 45 percent in regions 12 and 15 to 73 percent in 
region 9. Similar percentages were noted in our resurvey. 

Clearly, many of these forecasts reflect accurate employer judg- 
ments of expansion demand, e. g. , most of the correct forecasts yShre 
no-change forecasts. However, our employer interviews indicate several 
other important reasons for the high incidence of no-change forecasts. 
For example, some employers did not: 

Receive instructions to make a forecast 
Understand tliey were forecasting 
Make any forecast at all 

Consequently, we conclude that many of the forecasts reported as 
no-change were in fact non -forecasts. Several of the employers inter- 
viewed were sure that they had made no forecasts, but the printouts indi- 
cated no-change forecasts. More importantly, some employers kept 
copies of their original documents, verifying that, in fact, no forecasts 
were made. In our judgment, the high incidence of no-change forecasts 
is attributable not only to misunderstanding of instructions and /or an 
unwillingness to forecast, but also to counting no forecasts as no-change 
forecasts. 
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(3) Delays In Employer Submissions Shortened Forecast Periods 

Originally, OTIS demand data were to be gathered in June* 1972, 
Employers were asked to forecast their manpower needs for May 1 5, 
1973, and May 15, 1974, so that one -year and two-year forecasts would 
be available. Unfortunately, a substantial amount of the data were not 
submitted promptly. 

Exhibit XX, following this page, presents a distribution of the 

months during which data were submitted and received by OTIS. This 

exhibit shows most of the data being collected in September, October, 

and November, 1972, but also that data were still being collected in 

April, 1973. Consequently, the forecasts were probably submitted 

shortly after preparation and, of the 2,214 respondents: 
# 

247 employers, or slightly over 11 percent, made a forecast 
for 10 to 12 months. 

1, 856 employers, or nearly 84 percent, made a forecast for 
seven to nine months. / 

>, 

111 employers, or 5 percent, made forecasts for six months 
or less. 

This distribution of responses can be described as follows: 

The mean forecast period was 8. 53 months. 
The modal forecast period was nine months. 
The median forecast period was nine months. 

5. OTIS DEMAND DATA AS PRESENTLY CALCULATED DO NOT 
' REPRESENT TOTAL MANPOWER DEMAND 

Our analysis indicates that the demand data compiled in both states do 
not represent total manpower demand. The principal causes of incomplete data 
involved the current status of the system in Kentucky and the Instruments for 
collecting demand data in Oklahoma. 
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(1) OTIS Kentucky Was Unable To Incorporate Replacement Demand - 
Data Into The Total Demand Data System Since Attrition Rates 
Were Unavailable 

Total demand for manpower equals the total number of job openings 
that are available or are expected to be available over the course of the 
forecast period. In other words, total demand is comprised both of 
expansion demand and of replacement demand. 

Expansion Demand refers to changes in the number of jobs 
due to expansion or reduction in manpower needs. Thus, 
expansion demand is usually positive in expanding industries, 
zero in static industries, and negative in declining industries. 

Replacement Demand refers to openings created by normal 
attrition in the work force due to deaths and retirement. 

The OTIS survey instruments utilized in Kentucky collected projec- 
tions of the total number of positions expected to be available as of the 
forecast date. These forecast totals are compared to existing employ- 
ment levels to obtain the net change in positions available. Thus, OTIS 
Kentucky collects only expansio\i demand data. 

Kentucky was not able to incorporate replacement demand into total 
demand in the original system design because attrition data were not 
available. ^ However, combined death and retirement rates by occupation 
have been calculated recently from the 1970 decennial census data. The 
weighted average rates for the total work force in Kentucky are approxij 
mately 4 percent. It is reasonable to assume that the calculated death 
and retirement rates are representative of the manufacturing work force 
in Kentucky. Hence, these rates can be applied to the nirnibeir of employ- 
ees included in the OTIS survey in Kentucky to determine approximate ' 
replacement demand. The following illustrates this calculation: 



Tliete data axe now .tvailable and are being incar>orated into OTIS* 



The total v/ork force included in the OTIS Kentucky survey 
was 223, 293. The survey provided an overall projection of 
5, 200 new positions. 

Based on the calculated death and retirement rates shown 
above, the total replacement demand is about 9, ODD positions. 

Since total demand is computed by adding OTIS expansion and 
replacement demand figures, the total demand is about 14, 255 
In Kentucky for manufacturing employers. 

Finally, the result of a comparison of the expansion demand reported by 
OTIS and the probable total demand shows that OTIS Kentucky reports 
only about 37 percent of the total. 

(2) The OTIS Demand Survey. In Oklahoma Captures Data For Vocational 
Education Training Occupations 

Oklahoma utilizes a series of 11 forms in their demand survey. 
These forms were developed for particular industries and contain approxi- 
mately 280 DOT codes. The OQcupations selected represent the areas in 
which vocational training is conducted, i. e. , low-skill or menial occupa- 
tions plus highly trained professional classifications were excluded pur- 
posely. Unfortunately, these limitations preclude collection of total 
expansion demand. 

The Oklahoma survey included 2, 633 employers of nearly 375, 000 
people. Survey responses were received from 1, 865 employers repre- 
senting approximately 312,000 employees. An analysis of these responses 
indicates that over 30 percent of the work force of the respondents were 
employed in occupations not included on the form. As noted earlier, our 
resurvey substantiates this percentage. Thus, demand data cannot be 
assigned to these occupations and they are, therefore, exclr. Isil from 
OTIS totals and the cycle reports. 
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MANPOWER SUPPLY S T^ BSYSTEM 

This section presents our findings regarding the manpower supply sub- 
system. Specifically, the following characteristics of the subsystem are dis- 
cussed: 

The sources of information concerning manpower supply, 
including the student accounting system 

The information provided by the student accounting system 

. The comprehensiveness of manpower supply data 

1. THE SOURCES OF MANPOWER SUPPLY INFORMATION IN OKLAHOMA 
AND KENTUCKY ARE SIMILAR 

Oklahoma collects manpow t supplj' information from five sources. 
Kentucky plans to obtain supply data from similar sources. In both states, 
the student accounting system is the primary source of data on individuals 
with vocational training. However, the information provided by this system 
differs substantially in ecch state. 

(1) Implementation Of The Manpower Supply Subsystem Has Been 
Approached Similarly In Each State 

In Oklahoma, information concerning statewide manpower supply 
is obtained from five sources: 

The Oklahoma State Department of Vocational and Technical 
Education is the principal source of supply data, including 
data concerning: 

High school vocational program graduates 

Post high school vocational program graduates 

Adult vocational program graduates 

Manpower Development and Training Act (MDT^) 
graduates 
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The Governor's Comprehensive Manpower Planning Staff 
provides supply data on the number of graduates of federal 
training programs not associated with the State Department 
of Vocational and Technical Education. 

Bureau of Indian Affairs 

Concentrated Employment Program (CEP) 

Department of Corrections 

Migrant Education ' 

Work Incentive Program (WIN) 

Opportunities Industrialization Center (OIC) 

Rehabilitative Services 

Tulsa Urban League 

The State Accrediting Agency provides information on the 
number of private school graduates biased on licence applica- 
tions required annually by state law. 

OESC provides information on the number of qualified regis- 
trants available to fill jobs. 

The Oklahoma Board of Nurse Registration and Nurse Educa- 
tion, working jointly with the State Department of Vocational 
and Technical Education, provides supply information on the 
number of nurses available for employment. 

Information for vocational education and MDTA program graduates 
is reported automatically in Oklahoma through .the student accounting sys- 
tem, as described below. Supply data for the last four categories are 
reported by special arrangement with the responsible agency. Additionally, 
special studies are conducted to assess the manpower supply for each of 
the appropriate areas covered in the OTIS cycle reports. 

Ctirrently, the Kentucky system collects supply information primar- 
ily from state-funded vocational /technical programs, from DOL appren- 
ticeship programs, and from ES registrants. However, future plans call 
for the inclusion of additional sources of manpower supply similar to 
those utilized by OTIS Oklahoma. 
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(2) The Information Provided By The Student Accounting Systems In 
Oklahoma And Kentucky Differs Substantially 



As discussed in Chapter II, the student accounting system is the 
primary mechanism for collecting pnd processing manpower supply data 
in both Oklahoma and Kentucky. Exhibit XXI» following this page, pro- 
vides a comparative overview of the Oklahoma and Kentucky systems. 
In addition, the Oklahoma portion of the exhibit shows the interface between 
student accounting data and other supply sources discussed in the previous 
section. 

The student accounting system collects the following data: 

Enrollment data by student and course to establish a record 

Dropout /transfer data to update existing records 

Termination data to modify the existing data ba^je. These 
data are utilized in the supply subsystem and are being 
utilized in the student follow-up subsystem. 

The scope of information required for each state system differs 
substantially. In addition to the collection of data for tracking enrollees, 
transfers, and graduates, the Kentucky student accounting system will 
collect a broader scope of data than the subsystem in Oklahoma. The 
major differences in data collection are outlined below; 

Oklahoma collects the following four categories of disadvan- 
taged characteristics data: 

Not disadvantaged 

Member of a family in which the yearly income is less 
than $3, 000 

Academically disadvantaged and needs special programs 
or services 

Both economically and academically disadvantaged 
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In Kentucky, 10 categories of disadvantaged data are collec- 
ted: 

Not disadvantaged 
Academic 
Socioeconomic 
Aged 

Correctional institute inmate 
Cultural or linguistic isolation 
Dropout potential 
Correctional institute parolee 
Juvenile delinquent 
Migrant 
Other 

Oklahoma collects information concerning a student's aspira- 
tions in the occupational training area. In contrast, the Ken- 
tucky system collects data about a student's educational goals 
in the following categories: 

Obtain GED 

Complete high school 

Continue education in an on-the-job training program 
Enter military service 

Continue study in vocational, technical, trade, or 
business school 

Attend community college (two-year program) 
Complete college for bachelor's degree 
Study beyond bachelor's degree 
Other 

The Oklahoma termination card reflects only the following 
information, supplied by the teacher: 

Complete the training program and (1) graduate, or 
(2) leave school without graduatinjg 

Complete the training program and remain in the school 
in other course work 
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Complete this year in the training program and plan to 

continue in the program 

Drop out of the training program but continue in school 
Transfer to another school 

Dropped out of school and is employed full time in the 
field for which he/she was training 

Dropout or transfer and status is not known, or is 
deceased 

Was not in program this year 

The Kentucky system also tabulates terminations but, in addi- 
tion, collects a substantial degree of evaluative da ta in th ree 
areas: 

Degree of accomplishment rated by the teachers as: 

r 

Excellent 
Good 

Average , 
. . Fair 

Poor ^ 

Type of termination 

Reason for dropping out, according to the teacher 

Additionally, Kentucky plans to develop a more extensive linkage 
between the student accounting and follow-up systems, e. g. , to relate 
evaluative data to subsequent succetss. Tbis capability will provide for 
the eventual development of process and impact evaluation strategies. 

2. OT IS OKLAHOMA SUPPLY TOTALS ARE COMPRISED PRIMARILY OF 

GRADUATES FROM FORMAL TRAINING PROGRAMS AND EMPLOYMENT 
SERVICE REGISTRANTS 

In any discussion of manpower supply, job market entrants usually include 
individuals from the following sources: 
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Graduates of formal training programs such as vocational 
education programs and federal work/training programs 

Individuals formerly outside the labor force: 

Housewives desiring to reenter the labor force 
Handicapped workers 
Returning veterans 

People entering the labor for',e through immigrat'on or net 
in -migration 

" . Individuals formerly working in other occupations, i. e. , enter- 

^ ^ ing the labor pool through nonvocational education and upward 

mobility 

.An analysis of the operational supply subsystem in OTIS CMahoma indicates 
that OTIS manpower supply totals are comprised principally of graduates of 
- formal vocational training programs and registrants with OESC. Exhibit XXII, 
following this page, presents the composition of manpower supply reported in 
the OTIS Oklahoma Cycle Five Report by source and category. Of the 25, 769 
individuals, 11,561, or nearly 45 percent, were OESC registrants and 10,592, 
or over 41 percent, were graduates of vocational education programs. The 
remaining 14 percent were graduates of federal training programs and private 
schools. 

(1) Three Major Sources Of Job Market Entrants Are Not Included In 
\ OTIS Supply Totals 

\ ■ 

' A comparison of the Oklahoma sources of supply data indicates that, 

with the exception of company- trained individuals, persons receiving for--- 

mal vocational training appear to be adequately covered. However, three 

categories of labor supply entering the work force are not considered 

directly:- 



This problem has been lecognLse^ asd procedutes aie beixig developed to collect additioofti «iq>ply dk^ 



Outside the labor force 

Other occupations /nonvocational training 

Immigration 

Quantifying the extent of the omissions* i. e. , the number of individuals 
not included in supply, is extremely difficult. However, the results of 
numerous studies indicate that the number of people entering the job mar- 
ket from nonvocational schools and other occupations, i. e. , interoccupa- 
tional mobility, is considerable.*^ For example, many workers in Okla- 
homa entered the labor force from institutions that are not included in 
the sources of supply for the current OTIS report, e.g.: 

High school 
Junior high school 
Companies 
. Armed forces 

Correspondence schools 

In, addition, the OTIS supply component does not consider individuals 
entering the labor force with one to three years of college. However, 
recent studies in Oklahoma indicate that many of these individuals enter 
the job market in the area in which they received vocational training. 

Undoubtedly, some of the above persons omitted currently from 
OTIS supply data are includ?>d in the OESC registrants, which comprise 
approximately 50 percent of manpower supply. However, despite the 
relatively high Employment Service penetration rates in Oklahoma, it 
is likely that many workers are not included in the OESC totals. Thus, 
the published OTIS supply figures understate supply. 

The manpower supply subsystem in OTIS Kentucky is presently 
under development by the state professional staff. To date, little formal 
documentation of the supply component has been developed. Some MDTA 

U.S. Depaxtmest of Labor^ M^t^ower Mvaixdstxation, 0£Sce of Maspower, Automation, and Tirainiag, Fortnal 
Occupationat Traintog AdaJt Woartea. Maxpcwes/ Aatomatitm Reseaich Monograph No. 2, Washiogton, D.C; 
U,S. Govemusent Mating OfQce, 1964; and Youx^g, RotMurt C. , Maaoower jaformation For Vocational Baocatlen 
^Oanniiy. The Cesteer F&r Vocational And Technical Education, C&io SttM Univenity, Co&in^, Ohio, 
Noveniber, 1969; p. 10Z» 
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and apprenticeship program data have been collected. Generally, sub- 
system design appears to be similar to that of the OTIS Oklahoma sub- 
system. For example, the Kentucky system designers plan to utilize a 
supply component based on enrollments and graduations of: 

Public vocational schools 
Technical institutes 
Community and junior colleges 
Private vocational and business schools 
Federal training programs 

In addition to these data sources* the staff plans to collect in-migration 
data from Employment Security offices throughout the state. The method- 
ology for collecting, integrating, and utilizing ^e collected data has not 
yet been established for review apd analysis. 

*(2) Manpower Supply Forecasts Are Comprised Of A Mix Of Estimated 
And Current Data 

The supply forecasts contained in the OTIS Oklahoma reports are 
developed through the utilization of a variety of methods. 

Adjustments are made based on formulae developed from the 
student accounting system and foUbw-up. data. The adjust- 
ments are detailed in Appendix I. 

Private school graduate data are not adjusted. The previous 
year's graduation level is used as the forecast for the current 
year, i. e. , no forecast is made. 

Federal program graduate data are not adjusted. All graduates 
are assume'd to be job-ready. 

Employment Service registrants are not forecasted. Avail- 
ability and eligibility determinations are made by OESC per- 
sonnel based on registrant files. 

Thus, the OTIS supply forecast is comprised of a combination of 
OESC current registrant data and other adjusted and unadjusted supply 
estimates. 
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IN TERFACE. STUDENT FOLI.OW-UP. COST. AND 
EDUCATIONAL RESOURCES SUBSYSTEMS 

This section presents the results of analyses of the interface, student 
foUow-up. cost, and educational resources subsystems, Specifically, the 
topics discussed include the: 

Development and use of the interface statistic 

Differences in the scope of the student follow-up systems in 
Oklahoma and Kentucky 

Uses and potential of the cost and educational resources sub- 
systems 

1. THE INTERFACE STATISTIC SHOULD BE USED WITH CAUTION 

The interface statistic is the principal output produced by OTIS. Exhibit 
III, following page 6, displays a sample page of output from the OTIS Oklahoma 
Cycle Five Report. The interface statistic is determined by compaiing man- 
power supply for each occupation (DOT code) wiuiin a selected educational pro- 
gram cluster with forecasts of manpower demand for the same occupations. 
Thus, the interface statistic represents the net manpower requirements for a 
specific vocation training program cluster in a given planning area and on a 
cumulative basis statewide.-^' 

As noted earlier, some of the OTIS iorecasts of manpower demand are 
inaccurate and additional sources of manpower supply are required. However, 
even if manpower demand data were accurate and manpower supply data com- 
plete, the interface statistic should be used with caution. Some of the reasons 
why this statistic could be misleading are described below.2/ 



1/ Stt dbove^ pp* 6*^7* 

2/ The OTIS Cycle Rve Report also notes that the manpower supply and demand ubles should be Viewed dynam- 
icaUy , especially at the regional levels where changes in t^ plans of a single firm could significantly iaflueac* 
demand in a given occtipation. 



Manpower requirements data are aggregated statewide and by- 
region. However, commutation patterns can affect the restilts. 
For example, an excess of supply (people) for a particular 
occupation statewide or in a particular region may be offset 
by workers commuting to another state or region, e. g. , 
nearly 36, 000 more Kentucky residents commute to Ohio 
than Ohio residents commute to Kentucky.- 

In- and out-migration may alter the net manpower require- 
ment projections over the course of the forecast period by 
decreasing or increasing manpower supply. 

The jobs included in demand are not strictly comparable with 
the occupations listed in supply. For example, it is unlikely 
that vocational education enroUees in police science will be 
applying upon graduation for jobs as sheriffs. 

Not all of the graduates of manpower training programs are 
competent to perform the jobs for which they are trained due 
to improper training and /or attitudinal problems. Conse- 
quently, supply for a giv^n occupation may be overstated. 

Supply of manpower may not be available concurrently with 
demand. Therefore^ Imbalances between-demand and supply 
may occur over the course of the forecast period. 

OTIS supply counts all persons available for the labor market. 
However, in Oklahoma, OTIS demand includes only demand 
for selected occupations. Therefore, net demand is under- 
stated because many people in supply can qualify for jobs not 
included in the survey. 

Many trained individuals can and do qualify for jobs outside 
the scope of their training. For example, many workers 
have multiple skills and demonstrate a high degree of occu- 
pational mobility.^ Thus, supply for a particular occupa- 
tion can change with personnel shifts. 



ComaiOBitv Pattena ot Kentucky Countieg. Kentucky Department of Commerce 

Young, Robert C. , lAaspawia fafermation Far Vocational Education Plaaoiag. The Center For Vocatioaal 
Aad Technical Sducatior^ Ohio State Univesrity, Cohwnbui!, Ohio, November, 1969. 
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2 THE OP ERATION AND UTILIZATION OF THE STUDENT FOLLOW-UP 
SUBSYSTEM DIFFERS SUBSTANTIALLY IN EACH STATE 

The purpose, of the student follow-up system in both states is to track pro- 
gram participants, thereby establishing individual training and career linkages. 
However, the method of conducting the follow-up surveys varies, and. more im- 
portantly, the use of the surveys in Kentucky and Oklahoma differs substantially. ^ 

Kentucky uses a direct student follow-up technique as part of the student 
accounting system discussed previously. This approach consists of a periodic 
maiUng to a percentage, of former students. The form is completed by the ter- 
minee and returned to the state for analysis. Experience to date indicates: 

Of the 10.806 persons contacted in the pilot study. 48 percent 
or 5. 189 had responded after three mailings. 

A follow-up of 50 students was made to determine non-^ 
^ respondent information and /or bias. 

The collection data were utilized to prepare reports of the 
* following tyDC«5 

Currer ./ork- related activity by program area 
, " Job -related training program by program area 
i - Frequency of the use of learned skill by program area 

Wages earned by vocational program service area 

in contrast. Oklahoma follows up students by contacting the classroom 
instructor. Questionnaires are mailed to the former instructor of a program. 
The instructor is given a follow-up card for each student. Through his or her 
local knowledge'; and contacts, the teacher completes the follow-up card. The 
card contains a list of 10 possible post-training activities. The data produced 
were used in the development of Supplement V to the OTIS Cycle Three Report.^/ 
Individual data jire not collected for MDTA program students or special school 
students. In ac^ition. the Oklahoma State Department of Vocational^d Technical 

U ens cycle m Report, Supplement V. a follow^p rtudy of Oklahoma vocational a^d le^cal^catien 
graduatet and dr<ipo«te; 1968 - 1969 and 1969 - 1970. Division of Research, Planning, and Evajfaatioa. 
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EducaUon conducts a parallel foUow-up survey of students, stratif?-d by occiT- 
pational objectives, to validate the teachers' follow-up information. 

Thus, follow-up information obtained in Kentucky is much more compre- • 
hensive than that collected in Oklahoma. More importantly, Kentucky plans to 
develop a more extensive linkage between the student accounting and follow-up 
subsystems. The purposes of this linkage are: 

* «. To develop indices for evaluating the training process in terms 

of the success pr failure of program graduates 

To collect data to ensure the relevancy of training to the work- 
. ing environment encountered by graduates 

? 

Evaljiation of the educational process requires assessment of program 
impact. 'Accordingly, the data collection methodology of the student follow-up 
subsystem can be utilized directly to formulate a comprehensive evaluation 
Strategy that analyzes the inherent relationships among: 

Student graduate success and program resources requirements 
Student graduate success and program content 

Student graduate success and disadvantaged program consid- 
erations 

The resulting evaluation would provide key societal data for cost-benefit analysis 
and resource allocation decisions. The data provided by these subsystems are 
also necessary to support (1) placement and job development, (2) employability 
development and vocktional counseling, and (3) planning and development of 
training program curricula. 

3 THE OBJE CTIVES OF THE KENTUCKY COST AND EDUCATIONAL 
RESOURCES SUBSYSTEMS APPEAR TO BE SIMILAR 

OTIS Kentucky conceptual model contains both a cost subsystem and an 
educational resources sx&system. Our analysis of these two components indi- 
cates that tliese objectives are similar. 
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In concept* the cost subsystem was designed to produce two outputs: 

An analysis of program costs vs the benefits accrued to society 
and students. This analysis is to be based, primarily, on data 
collected by the follow-up system and financial data collected 
by the State Department of Vocational and Technical Education. 

A cost-benefit report presented to the state director, state 
board, local boards, executive secretary for CAMPS, the 
Governor, and the state legislature. The basis of this report 
is the cost-benefit analysis. 

According to the OTIS Final Report, the cost subsystem was to be forniulated 
"to help determine program mix. i. e. , the proportionate distribution of 
resources among occupational program service areas."- 

An educational resource inventory data file has been started in Kentucky. 

Principal data include: 

Buildings, including schools, classrooms, shops, laboratories, 
and other structures for educational instruction and administra- 
tive purposes 

Equipment , including instructional equipment (i. e. , desks, 
machines, typewriters, car engines, shop tools, etc. ) and 
maintenance equipment 

Personnel , consisting of an inventory of teachers, adminis- 
trators, maintenance personnel, and support staff 

In addition, plans are being formulated to add community characteristics, indus- 
trial and economic analysis, land-use, and community services data. These 
elements are not part of the OTIS system developed for Kentucky. 

The objecUve of the educational resources subsystem is to provide data 
to program planners involved in making resource reallocation decisions that 
reflect factual considerations of currently available facilities, equipment, and 
personnel. The system will relate requisite resources to specific programs 
to be undertaken. Further, these resources can be compared to the specific 

P Braden, Paul V. , et al, Occupational Training Infonoation System fOTIS^ Final Reooit. Research Foundation, 
OWahoma State University, Stillwater, C«<laJK>ma, 1970; p. 44. 
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goals and objecUves of the planned program. Subsequently, the analyses sup- 
ported by this subsystem may be combined «ith evaluations of program impact 
based on student follow-up data to facilitate more extensive planning and evaluaUon. 

This original objective and uses of these subsystems appear to be identical. 
Thus, in our judgment, the educational resources and the cost subsystems in 
Kentucky could be combined into one comprehensive system, thereby providing 
users with both resources and cost data so that resource allocations can be 
made effectively. 

nvT^RAT.T. SYSTEM AN D SYSTEM IMPACT 
our findings regarding the overall OTIS system and its impact and repUca- 
biUty are presented in this section. Specifically, the following topics are discussed. 

The similarities between OTIS information needs and the needs 
* of a ^Jpical labor market information (LMI) system 

The extent to which OTIS output is utilized for state and local 
planning 

OTIS development and operating costs 
The cost of replicating OTIS in other states 
1. OTIS IS A SPEC! AT. -PURPOSE LMI SYSTEM 

As originally conceived. OTIS was a self-contained system providing com- 
prehensive information for state vocational education and manpower planning. 
However, much of the information gathered, processed, and reported by OTIS 
is Similar to the information processed by the Employment Service. ExhxbU 
XXin. following this page, lists 28 broad information needs that should be met 
by an LMI system in a large metropolitan area and compares these data wxth 
informaUon processed by OTIS. The OTIS system incorporates only one-half 
of the needs specified for the LMI system. Consequently, OTIS can be viewed 
as a special-purpose LMI system, i.e. . as part of a much larger manpc-er 
system. 
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2. OTIS DATA ARE UTILIZED IN THE PLANNING PROCESS BY BOTH 
OKLAHOMA AND KENTUCKY 

The principal objective of OTTS is to provide the regional and state plan- 
ning and operating information necessary to formulate educational, manpower, 
and economic development plans and policies. Our analysis indicates that OTIS 
data are utilized in the planning process by both Oklahoma and Kentucky. 

(1) OTIS Output Influences Directly The Oklahoma State Vocational 
Education Plan 

Prior to the development of OTIS, state officials believed that ade- 
quate planning data were not available and /or that existing data were: 

Aggregated only at the national and state levels 
Not easily disaggregated 

Limited to certain uses because of confidentiality constraints 

More importantly, local level occupational data were not expected to be , 
available soon. Thus, OTIS was developed to produce regional aggrega- 
tions of demand and supply data by occupation and to incorporate these 
data into a comprehensive planning process. Therefore, OTIS has been 
widely accepted because it gathered local data and produced local regional 
aggregations of supply and demand oy occupation. Additionally, in the 
judgment of users, OTIS produces a straightforward set of data. 

The data produced by OTIS are utilized in the formulation of the 
Oklahoma Vocational Education Plan. For example, provisions of the 
plan require that: 

"In allocating funds among local educational agencies, the 
State Board shall give due consideration to information 
regarding current and projected manpower needs and job 
opportunities on the local, state, and national levels. 

"The State Board shall give particular consideration to those 
local educational agencies whose proposed vocational educa- 
tion programs are best designed to: 

1/ Oklahoma State Plan 
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Fulfill current or projected manpower needs in existing 
occupations at the local level by preparing students for 
current or project*^d job opportunities? in such occupa- 
tions, or 

Fulfill new and emerging manpower needs at the local* 
state, and national levels by preparing students for new 
and emerging job opportunities at such levels. ' - 

More imp. -tantly, the Division of Vocational and Technical Education has 
been directed to establish only those new programs that are able to demon- 
strate a high level of employment demand. Consequently, the Division 
has developed a planning process incorporating this mandate. 

Exlubit XXrV, following this page, presents an overview of the Okla- 
homa vocational education planning process. A formula has been developed 
to weight the various criteria considered in funding new programs. The 
criteria and weights comprising the formula are: 

Manpower needs --weight 5 
Vocational education needs— weight 5 
Relative ability to pay— weight 3 
Excess costs — weight 2 

The weights are based on data obtained from the student accounting system. 
However, the emphasis on manpower demand is clear and these data are 
obtained from OTIS. 

(2) Kentucky Is Incorporating OTIS Data Into The Planning Process 

Kentucky also plans to integrate OTIS data into the state and local 
planning process. To date, OTIS has had limited impact on the state edu- 
cational planning system because the system is new and interface output 
has not been produced. However, the results of our interviews indicate 
that Kentucky plans to use data produced by OTIS for applications similar 
to those in Oklahoma. Currently, plans are being developed to build on 
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the experience of the first year of operations and to implement a series of 
steps to refine the OTIS data collection methodology. These steps include: 

Conduct a census survey of three segments of nonmanufactur- 
ing emplojrment: 

Mining 

Contract construction 
Transportation 



. ^ Analyze and adjust the student data system from the standpoint 
of feasibility. Determine system adjustments and identify 
users and user needs. ». 

Define sources of supply data and develop procedures for 
obtaining supply information. 

Review the former student foUow-up system to identify pro- 
cedural changes. In addition, identify user needs and develop 
rep : rting format^ . 

Prepare and initiate procedures for updating manpower supply 
and demand components of the system. 

Analyze pilot study results to determine further steps in the 
implementation process. * 

Develop comprehensive lists of private and public training 
^ programs within the state. 

3. OTIS OKLAHOMA AND OTIS KENTUCKY EACH HAVE UNIQUE COST 
CHARACTERISTICS 

Exhibit XXV, following th2% page, presents the separate costs for devel- 
oping and operating OTIS in Oidahoma and Kentucky: 

Development costs include expenditures for system design, 
development, programming, and test activities. 

. ' Operating costs include the normal expenses incurred in col- 
lecting supply and demand. data, producing and distributing 
the interface statistics, and utilizing the other subsystems 
for planning and resource allocation. 
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OTIS DEVELOPMENT AND OPERATING COSTS 
IN OKLAHOMA AND KENTUCKY 



( 



Oklahoma 



Kentucky 



DEVELOPMENT COSTS 



(1) 
(2) 
(3) 
(4) 
(5) 



Demand Subsystem 
Supply Subsystem 
I&terface Swbsyrtem 
FoUow-Up St^systcm 
Educational Resouzces Subsystem 



Toul I^velopmeat Costs 

i 



^ $ 203,500 



$ 101,997 



22,694 



203. SOO r$ 124.691 



2. ANNUAL OPERATING COSTS 

(1) Demand Subsystem 

(2) Supply Subsystem 

(3) latexface Subsystem 

(4) Follow-Up Subsystem 

(5) Educatl«»al Resources Si&system 



$ 18.938 
9,764 
2,500 



$ 110,356 
51,890 



23.180 



Total Operating Costs 



1/ Cotts of the foUaW'Vp Sub*yitem are included in the &xpply Subfyitem. 

Source s Tie soujce and derivation of the CSdahoma and Kentucky co^ are contained in 
Appendices B and C, respectively. 



As expected in a pioneering effort, OTIS development costs are higher in Okla- 
homa than in Kentucky. Conversely, annual operating costs are higher in Ken- 
tucky because of the demand data collection methodology utilized. The compo- 
sition of these costs in both states is detailed below. 

(1) The Costs Of Developing And Operating OTIS Oklahoma Are 
Approximately $200, OOP and $31, OOP, Respectively 

The costs of developing and' operating OTIS in Oklahoma are presen- 
ted in Exhibit XXV. The development costs were incurred over several 
years; the operating costs are based on Fiscal Years (FY's) 1972-1975. 

The estimated development costs of approximately $20P, 000 are 
comprised of: 

A grant of $153, 500 *'> the Oklahoma State University Research 
Foundation from var*>:us federal and state agencies for system 
design and development 

Computer time and other related expenses of approximately 
$50,000 

The annual cost of operating OTIS in Oklahoma is approximately 
$31,000. These operating costs include: 

$18, 938 for the demand subsystem . 

$ 9, 764 for the supply and follow-up subsystems 

$ 2, 500 for the interface subsystem 

The relatively low annual operating costs reflect the fact that in Oklahoma 
benchmark demand data are collected through a sample every four years. 

The calculation of the annual operating cost of the demand subsystem 
is detailed in Appendix B. Essentially, this cost was derived as follows: 

The total costs of the OESC contract with the Oklahoma Depart- 
ment of Vocational Education and Office of Community Affairs 
and Planning (OCAP) were $120, POO. 

^ . The total costs of the OESC baseline survey data collection 

. effort were approximately $102, 500. 
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The OTIS share of this expenditure was approximately $58. 300. 
The remaining costs are attributed to OCAP. 

The update costs in FY 1973. 1974, and J 975, are estimated to 
be approximately $7. 450, $4, 980, and $4, 980, respectively. . 

The total baseline and update costs of approximately $75, 750 
are c^ivided by four to obtain annual operating costs of $1B. 938. 

The allocation of the annual costs of the supply and follow-up subsys- 
tems is also detailed in Appendix B . Specifically, these costs are a portion 
of the total annual costs of operating the student accounting system. 

(2) Development And Operating Costs of OTIS Ken tucky Are 
Approximately $125.000 And $185,000, Respectively 

An accurate determination of the true costs of the OTIS model in 
Kentucky is difficult because all costs are recorded in line-item budgets. 
Thus, the allocation of expenditures to particular activities requires recon- 
struction of work loads, assignments, and supportive expenses. The 
reconstruction and allocations utilized herein were developed in conjunc- 
tion with key officials in Kentucky. All of the assumptions and calculations 
are detailed in Appendix C. 

As displayed in Exhibit XXV, following page 62, it has cost approxi- 
mately $125,000 to develop the OTIS model in Kentucky. This figure ^s 
comprised of approximately $102,000 for the demand system and $22, 700 
for the follow-up system. The' demand subsystem development costs include: 

$68,697 for contractual and consulting services for system 
design and development 

An estimated $14, 500 for computer program development 

An estimated $18, 800 in EDA technical assistance support 

The ciosts for developing the follow-up subsystem represent only Kentucky's 
share of an EDA contract with Ohio State University for the development 
of a system for Kentucky and West Virginia. 
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The current operating costs for OTIS Kentucky are approximately 
$185, 500 and include: 

$110,356 for the demand subsystem ? 

$ 51.890 for the supply subsystem 

$ 23, 180 for the education resources subsystem 

The demand costs are comprised principally of personnel costs and travel 
expenses. The costs of the field staff alone were over $70. 000. including 
over $50. 000 for the salaries of field surveyors. The salaries of field 
surveyors were included because, in judgment, they represent a valid 
demand data collection expenditure. Obviously, if these expenditures were 
not included, total operating costs would be substantially less. With the 
exception of approximately $10,000 in materials for the supply subsystem, 
personnel expenditures comprise the costs of the supply and education 
resources subsystems. 

Determining annual operating costs in Kentucky is difficult because 
much of OTIS still is not fully operational. In our judgment, the annual 
costs of collecting demand data will remain at current levels because of 
the census approach to demand data collection or increase due to the larger 
number of nonmanufacturing employers to be surveyed. This assumption 
is reasonable and is in accordance with the assumptions of key personnel 
involved with OTIS. When the remaining subsystems are implemented fully, 
operating costs will probably equal or exceed current expenditures. Con- 
sequently, the annual operating costs of OTIS in Kentucky are estimated to 
be approximately $185,000, 

4. THE COSTS OF REPt^TcATlkG THE KENTUCKY DEMAND DATA 
COLLECTION SYSTEM ARE EXCESSIVE 

The fundamental distinction between the Oklahoma and Kentuqjcy demand 
data collection methods is that Kentucky conducts a census and Oklahoma, a 
sample. In addition. Kentucky utilizes personal interviews exclttsi/ely and 
Oklahoma contacts large employers personally and small einployers by mail 
and telephone. In result: 
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Oklahoma attempted to obtain data from a sample of 2,636 
employers from all sectors of the state's economy at a field 
data collection cost of $16,000, or approximately $6 per 
employer. 

Kentucky attempted to obtain data from a census of 2, 894 

employers in the manufacturing sedtor a,t a field- data -coUec- 

tion cost of approximately $80, 000. or approximately $28 per 
employer. 

Exhibit XXVI, following this page, lists the number of employers and 
total reported employment in Kentucky by major industry group. TJiis exhibit^ 
also presents the estimated cost of conducting a census of Kentucky employers. 
The total field cost of demand data collection is $1.2 million, assuming a cost 
per firm of $25.00. Retail trade employers comprise 33 percent of the number 
of employers and only 20 percent of total employment. If these smaller firms 
were excluded or surveyed by mail, demand data collection costs for the remain- 
ing firms still would be over $800, 000. Conversely, a 10 percent sample similar 
to that used in Oklahoma would cost from approximately $29, 000 to $120. 000, 
depending on the extent of the personal interviews. Thus, thQ?additional costs 
of conducting a personal interview census could be more than $1 million. 

Exhibit XXVII, following Exhibit XXVI, presents the estimated cost of repli- 
cating the Kentucky and Oklahoma demand data collection methodologies in other 
states. 

i , The cost of utilizing a census ranges from slightly over $200, 

000 in Nevada to over $8 million in New York. 

The cost of using a 10 percent sample similar to the sample 
used in Oklahoma ranges from $4,890 to nearly $200,000. 

The additional cost of conducting a personal interview census ranges from 
nearly $200, 000 in Nevada to over $7. 8 million in New York. Thus, in our 
judgment, the cost of utilizing the Kentucky OTIS demand data collection approach 
is excessive. 

« H' ❖ * 
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ECMBITXXVI 



EcoBomic Development Administration 



OTIS KENTUCKY DEMAND DATA 
COLLECTION COST ESTIMATES 



Estimated Data Collection Costs 

.. TotaF Reported — Number of CensuTTSx tO^ Sample ^ 

Ma^or hdustav Gtoup Employment Repoitxng Units ^5/lft>it f2S/Unit f6/tJhit 



Agricultnie 


2,613 


342 


$ 


8y 550 


$ 


850 


$ 204 


Contract Consttuction 


39»71(> 


4,460 




111, SOU 




11, 15U 


2,070 


Mining * 


29»472 


1,092 




27,300 




2,730 


654 


Manix&cturing 


234,508 


2,214 




55,350 




5,535 


1,326 


Transportation 


40,354 


2,108 




52,700 




5,270 


1,266 


Wholesale Trade 


46,699 


3,751 




93,775 




9,378 


2,?50 


Retail Tsade 


138,944 


16,305 




407,625 




40,763 


9,786 


Financial, Inraxance, and 
Real Estate 


35,641 


3,930 




98,250 




9,825 


2,358 


Services 


123,466 


13,142 




328, 550 




32,855 


7,884 


Unclassified 


6.763 


1.465 




36,525 




3.663 


882 


Total 


698.176 


48.809 




1.220.225 




122,019 


$ 29.286 



Totol State EmFaoyment 928,000 
Fevcexttage Reported 75,28 
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This chapter has presented our findings regarding the operational effec- 
tivcaess and overall impact of OTIS. In general, the systems in both Oklahoma 
and Kentucky have widespread support and are providing data that are utilized 
in the planning processes. However, several major problems persist. In our 
-judgment,- the e mploye r^ foreca^ts-of^anptDwer- dematid-arenmreliabie. i/— In 
addition, the personal interview census utilized in Kentucky to collect current 
and forecast demand is not cost effective. Equally important, OTIS manpower 
supply does not include all informally trained individuals. Our recommenda- 
tions for overcoming these problems are presented in the next chapter. 



These remits arc neither new nor jmprisiug. Many experts in the field believe employer-based forecasts ?je 
not reliable. In fact, as a result of laimeraus studies, DDL has dropped a similar progranu See: (1) John 
Fletcher Wellintyer Associates, An Appraisal Of Area Skill Surveys In Battle Creek. NHchigan. And Trenton. 
New Teisev. November, 1965, Wasliisgton, D.C; (2) Chemick, Jack, Manpower Fo recastiag Through The 
Occupational Needs Survey. Institute of Management and Labor Relations, Rutgers— The State University; 
(3) Hartle, Douglas C. , Canadian Employer Forecast Survey. Canadian Studies In Bconomics, University of 
Toronto Press, 1962; (4) Mcxer, Collette H, , An Evahiation Of Area Skill Surveys As A Basis For Manpower 
IH>licies. ap ui?mblished doctoral di»ertatiQn at the University of Wisconsin, 1971; (5) Labor Market hifor" 
matiop And The Federal-State Employment Service System . Report by the Advisory Committee on Research 
to the U.S. Employment Service, U.S. Department of Labor, Washington, D.C,; and (6) Kidder, David E., 
Review Anc^ iSyntbesis Of Research On Manpower Forecasting For Voc ational Biucation. The Center For Voca- 
tional and Technical BJtJcation, The Ohio State University, Columbus, CSiio, Febnary, 1972. 
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IV. RECOMMENDATIONS 



The purpose of this study was to analyze OTIS in Kentucky, determine its 
strengths and weaknesses, and recommend system improvements. Since OTIS 
Kentucky is still under development, the ongoing OTIS system in Oklahoma also 
was examined. System strengths and weaknesses weree^described in the succeed- 
ing chapter. Our recommendations for improving OTIS are presented below. 

1. THE DEVELOPMENT AND TESTING OF OTIS KENTUCKY SHOULD 
BE CONTINUED 

The basic purpose of OTIS is to provide manpower and vocational educa- 
tion planners with state and regional data. OTIS Kentucky is still under devel- 
opment. To date, the system has gained widespread support and preliminary 
data are being utilized in the planning process. In our judgment, the type of 
information provided by OTIS meets a valid need and we believe the develop- 
mental effort should be continued. 

Kentucky plans to continue OTIS operations and is willing to commit state 
fiinds for further system development. In addition, the state has requested 
further funds from EDA. We recommend that these additional monies be granted. 
We also recommend that technical assistance be provided by BLS. Collectively, 
these federal ana state resources should be utilized to make the following improve- 
ments. 

Implement a new employment data collection methodology by 
expanding the Occupational Employment Statistics (OES) program. 

Implement and test a new approach to forecasting manpower 
demand, using the industry-occupational matrix technique 
developed by BLS. 
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Improve the estimates of manpower supply by obtaining addi- 
tional long-term information concerning occupational and 
geographic mobility. 

Increase the rapport between employers and vocational educa- 

tlon pejrsjjnnel by discussing with each_em^oyerLkis.pa.iiticul§^ 

needs. 

Each of these recomm.endations is discussed in detail below. 

/ 

2. THE PES SURVEY SHOULD BE UTILIZED TO COLLECT CURRENT ' 
EMPLOYMENT DATA 

In 1970. BLS, the Manpower Administration (MA)» and a number of state 
employment agencies joined to initiate the OES survey. (The development, 
objectives, and current status of this survey and related BLS/MA programs are 
described in Appendix J. ) Kentucky was not one of the initial states participating 
in this program. However, the OES survey is now being implemented in Ken- 
tucky. In our judgment, this program spovld be used to collect current employ- 
ment data for use in OTIS. 

The PES survey was selected for the following reasons. ; 

Collecting manpower data is an integral part of the ES function. 
ES personnel are expert in this field. 

Manpower data are the responsibility of DOL and affilis^ted 
state agencies under the 1968 amendments to the Vocatjlonal 
Education Act of 1963. 

The survey utilizes a statistical sample rather than a jiensus. 

The adoption of the OES survey will eliminate redundant OTIS 
data collection activities. 

The survey is compatible with the systems in use in other 
states and with the BLS industry-occupational matrix. 

The OES survey is one of three components of the OES program and is 
designed to produce estimates of occupational employment by industry for the 
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nonagriculture wage and salary work force. Specifically, the OES survey has 
the following objectives. ' 

Develop occupational employment estimates by industry to 

„ . provide-the basifr for producing a-time series of estimates ~~ 

of employment by occupation 

Provide data about the occupational composition of industries, 
including: 

Differences in occupational composition within an indus- 
try, e. g. , by size of establishment, process 

Extent of inter -establishment variability 

Changes in occupational composition in response to 
such external factors as changing technology 

Provide occupational information in a form that permits the 
development and improvement of industry-occupational matrices 
at the state and area levels and, ultimately, at the national level 

In our judgment, the OES survey can meet the information needs of OTIS 
users in Kentucky if certain refinements are made. Our recomLmendations for 
specific refinements in the survey parameters are described below. 

(1) Jointly Develop A Sampling Procedure That Will Permit 
Compilation Of Reliable, Local- Level Data 

As noted above, OTIS data are utilized in the educational planning 
process in both Oklahoma and Kentucky. In addition, information from 
OTIS has helped to attract new industry in both states. Clearly, job pros--- 
pects and trends data are essential for: 

School and vocational /technical education administrators 
Manpower program administrators 
Economic development officials 
ES and vocational counselors 

Equally important, disaggregated data are required. However, sample 
size, data collection problems, and costs increase with the number of 
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substate areas involved. Thus, the increased cost and complexity of an 
expended sample must be balanced against the need for improved data. 

Currently, OTIS collects data from a census of employers, but 
this method is not cost effective. It is our understanding that the ES in 
Kentucky plans to select a sample to permit data compilation for four 
principal regions. This decision should be reviewed carefully with OTIS 
users, especially the Bureau of Vocational and Technical Education. In 
our judgment, alternative sample designs and concomitant data reliability 
should be developed. | For example, the reliability and costs of collecting 
four regional data samples should be compared with the reliability and 
cost involved in collecting data from the 1 5 regions utilized in the OTIS 
survey. In this respect, the existing OTIS data bank, which contains 1972 
employment by occupation from the census of manufacturing employers, 
might be useful in developing sampling alternatives. This information 
then can be utilized to make a valid judgment regarding the most appro- 
priate sampling methodology. Perhaps combining certain OTIS regions 
to limit the level of data aggregation and reduce cost will be warranted. 

(2) Complete An Entire OES Survey As Soon As Possible 

The standard OES survey consists of three separate annual surveys. 

Manufacturing employers 
Nonmanufacturing employers 
Trade employers 

Each group is surveyed every three years, using the standard forms devel 
oped by BLS for the industries in each group. Existing plans provide for 
the conduct of the manufacturing survey in the summer of 1974. Thus, 
nonmanufacturers and trade employers will be contacted in 1975 and 1976, 
respectively. 

We recommend that this schedule be shortened. Given the immedi- 
acy of information needs and the necessity of testing and validating a state 
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industry-occupational matrix, we believe all three major categories of 
employers should be surveyed this year. More importantly, we recom- 
mend that firms from all three groups be surveyed annually for the initial 
three-year cycle. This will provide current data and an immediate time 
series to develop the BLS "shift" matrix described below. At the end of 
the three-year cycle, data and forecasts should be available to evaluate 
properly the feasibility and impact of switching to the regular three -year 
survey cycle. 

MA estimates that the first round of any portion of the OES survey 
in Kentucky, such as manufacturing, would cost approximately $48, 000. 
This includes the costs of developing a current sampling frame stratified 
by SIC code and size of establishment and selecting a stratified random 
sample. Thus, in our judgment, the cost of conducting the modified OES 
program recommended above still will be less than the existing cost of 
collecting OTIS data. More importantly, in the long run, the OES survey 
will be even more cost effective. For example, it is probable that once 
the program is fully operational the regular three -year cycle can be utilized. 
In addition, smaller samples will be utilized in future surveys, since indus- 
tries which do not exhibit significant changes in their occupational structure 
can be sampled less frequently and those which have similar occupational 
structures throughout the nation need be sampled in only one or two labor 
market areas. % 

(3) Utilize The Survey Data To Develop Industry-Occupational Matrices 
For The State 

The OES survey data should be utilized immediately to develop 
regional industry -occupational matrices for Kentucky. The process that 
has been used to prepare occupational employment estimates from the 
sample data involves four basic steps. 
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The reported occupational employment figure for an establish- 
ment is multiplied by the establishment's sample weight. . 

The weighted occupational employment figure for the estab- 
lishment is summed with similar data for all other sample 
establishments in the same industry size class^ (cell). 

The sum of the weighted occupational employment data is' 
divided by the sum of the weighted total employment for all 
reporting establishments in- the cell. This produced the* occu- 
pational ratio for the cell. 

The ratio is multiplied by the total industry employment figure 
for the cell, as determined from ES 202 data, to yield the esti- 
mated number of workers in each occupation in the cell. 

This process can be expressed by the formula below. 




where: 

P = Estimate for occupation P in an industry size cell 

c 

p. - Reported employment for occupation P by number 
^ of establishments in an industry size cell 

M = The ES 202 benchmark employment for the industry 
size cell 

e, = Reported total employment in the ith establishment 
^ in an industry size cell 

w. = The reciprocal of the sample weight or the sampling 
^ ratio ol the ith establishment in an industry size cell 

The occupational estimates produced for each cell can be aggregated 
at various levels to produce data on the ocuupational composition of the 
wage and salary work force at different levels of industry detail, e. g. , 
three-digit or two-digit SIC code industries. Subsequently, these regional 
industry-occupational matrices can be developed and utilized in conjunction 
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with the BLS forecasting methodology to project manpower demand by 
occupation* 

OTIS KrvMTTT PKY SHOULD UTILIZE TIIE MANPOWER DEMAND 
"FORECASTING METHODOLOGY DEVELOPED BY HLS 



The results of our analysis of employer forecasts and of the regional occu- 
pational summaries in Kentucky indicate that many of the forecasts were inac- 
curate. More importantly, the annual cost of conducting a personal interview 
census is inordinately high compared to the cost of conducting a sample. Con- 
sequently, in our judgment, the Bl.S demand data forecasting methodology should 
be substituted for th.> employer forecast tor the following reasons. 

The BLS program is the result of years of research conducted 
by acknowledged experts in manpower demand forecasting. 

The UL3 methodology consists of a rigorous analytical frame- 
work. Thus, exogenous variables affecting manpow^ demand 
can be accommodated, e.g., the present energy cri^s, mone- 
tary and fiscal constraints, and wage and price controls. 

Forecasting manpower demand is an integral part of the over- 
all function of ES. 

The National /State Industry-Occupation Matrix oystem was inaugurated 
by BLS in 1972. The overall system was developed in conjunction with the MA 
and state employment security agencies to develop occupational information at 
the state and regional levels. 

/ 1 ) TTf ni.^ Th^ Kentucky Interim Manpower P ro^iections And Industry- 
Occupation Matrix To Develop Imm ediate Forecasts 

BLS has produced interim industry -occupation projections for Ken- 
tucky and a 1970 matrix. This matrix is similar in format, concept, and 
data base to the BLS national matrix and is based on a special tabulation 
of industry by occupation by class of worker from the 1970 census, as 
well as other industry data. The purpose of this system is to provide: 
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A state employment matrix for over 400 occupations in over 
200 industries that can be utilized to estimate occupational 
requirements with greater accuracy than national patterns 
alone 

A flexible, multipurpose computer system to allow 
updating, e. g. . to supplement the matrix Myith data from OES 
survey and prepare substate estimates 

This system also includes occupation-specific death and retirement rates 
for Kentucky that can be utilized to estimate total occupational demand. 
Since the OES matrix-based projections will not be available the first year, 
we believe this interim matrix should be utilized to develop manpower 
demand projections. 

(2) Utilize The State Matrices To Produce Annual Updates Of 
Manpower Demand 

As noted earlier, two years of OES data are necessary to determine 
^ shifts in industry-occupation ratios. Projections for the second year can 
be ^riiade using the matrices developed specifically for substate areas. In 
addition, the actual manufacturing employment figures for 1972 obtained 
by OTIS might be useful for matrix development. In turn, these matrices 
can be utiUzed in conjunction with industry employment projections to 
develop forecasts of manpower demand by occupation. The state ES should 
determine appropriate forecast periods in consultation with major data 
users and prepare total employment projections by industry. For example, 
3-, 5-, and 10-year projecttons with annual updates might be feasible. 
Subsequently, the accuracy of these state and regional forecasts should 
be evaluated. 

THK ESTIMATES OF MANPOWEF SUPPLY SHOULD BE IMPRO VED 
The OTIS estimates of manpower supply are presently understated because 
a substantial number of individuals entering the job market from nonvocationai 
schools are not included. In addition, migration and commutation patterns can 
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have a significant impact on supply in any particular area. Consequently, addi- 
tional research on occupational and geographic mobility should be undertaken. 

(1) Adjust The Supply Figures F or Informally Trained Individuals 

The principal deficiency in the OTIS supply totals is that informally 
trained individuals are not included, e.g., persons from high schools or 
individuals who have become proficient through informal training or exper- 
ience on the job. The number of informally trained individuals is extremely 
difficult to quantify particularly at the occupation level. However, because 
net manpower requirements can be Substantially affected by an understate- 
ment of supply, some effort must be devoted to estimating the extent of 
the understatement. 

There is a paucity of data in this area. BLS, in an attempt to alle- 
viate this problem, is currently conducting two studies in this area. 

An analysis of the sources of training based on 1970 census 
data 

An exai^ination of training provided by employers based on 
the 1970 census of maniifacturers 

Both of these studies may yield valuable information concerning the inci- 
dence of informally trained individuals in the work force. Some of the 
data also might be relevant at the state level or suggest similar research , 
using state data. In addition, the expanded scope of the follow-up subsys- 
tem discussed below will provide additional information on which to base 
expansion of the OTIS supply figures. 

(2) Identify The Extent Of Geographic Mobility 5' 

As noted earlier, labor mobility can have a significant impact on 
manpower supply in a particular area and, hence, on net manpower require- 
ments. In the judgment of knowledgeable officials, current net migration 
. in Kentucky involves approximately i, 500 individuals per year. ,Thus. %e 
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impact probably is not significant. However, intra- and interstate commu- 
tation does involve a substantial proportion of the work forc^ in Kentucky.-J-^ 
It probably is not feasible to quantify commuting patterns-a>5^ occupation. 
However, two approaches that could be taken to provide additional infor- 
mation to be used in conjunction with the regional OTIS net requirements 
data are: 

Intrastate Commuting — The county commutation patterns could 
be utilized to develop approximate conunuting patterns for the 
regions selected for OTIS. These figures then could be utilized 
in conjunction with the net manpower data to make planning 
decisions. 

Interstate Commuting- -Demand and supply estimates for the 
adjacent states should be compiled so that judgments can be 
made utilizing data Tor the entire interstate area. 

In addition, the expanded follow-up system discussed below will yield 
data on commuting patterns. 
5. ADDITIONAL FOLLOW-UP STUDIES SHOULD BE CONDUCTED 

Currently, follow-up in Kentucky is based on information from the student 
accounting system. All terminees from state vocational -technical schools and 
area vocational education centers are sent questionnaires shortly after gradua- 
tion. The follow-up includes information on the post- schooling experience of 
terminees by occupation and relationship'to training programs, in- -me, geo- 
graphffc mobility, and job satisfaction. In addition, a sample of terminees is 
interviewed personally to determine if non-response bias exists. These follow- 
up procedures have two principal shortcomings. 

THe period shortly after graduation t^nd's to be V transitional 
period and may not accurately represent long-range trends. 

Only terminees of occupational training programs are included. 

7^ CommutiBg Patterns Of Kentucky Couaties. Kentucky Department of Commerce, Frankfort, Kentucky. 
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In our judgment, additional follow-up studies should be conducted two to five 
years after graduation. Further, longitudinal data could be gathered by follow- 
ing the same terminees over one or more years. More importantly, terminees 
from non-occupational training programs should be included, e.g. , from high 
sch<^s and community colleges. The results of Ihese studies should provide 
ds^ifih which to assess the long-term impact of vocational training and to ^ 
determine the occupational and geographic mobility of graduates from all types 
oi schools in Kentucky. 

6. THE QUALITATIVE ASPECTS OF VOCATIONAL EDUCATION SHOULD 
BE EMPHASIZED TO INCREASE EMPLOYER RAPPORT 

One of the important intangible benefits of OTIS is the rapport obtained 
with employers. However, as noted earlier, rapport was not established with 
some employers for a variety of reasons. In our judgment, the level of rapport 
can be increased by separating data collection from other activities and by empha- 
* sizing the qualitative aspects of vocational education. For example, under cur- 
rent procedures, rapport is sought by asking the employer for current and fore- 
cast employment by occupation and by emphasizing the benefits of OTIS. This 

' is done within the tight time ronsUaints necessary to meet Ha.ta collection require- 
ments. Consequently, scheduling and conducting interviews are difficult for both 
vocational education personnel and employers. 

Using the OES/BLS demand data collection and forecasting methodology, 
the industrial coordinators will receive the OTIS forecasts for their region. Sub- 
sequently, as part of their normal functions, the coordinators can discuss these 
occupational projections and related information with employers.. More impor- 

; tantly, they can take the time to discuss the qualitative aspects of vocational 
education, e.g. . the characteristics of a typical job and/or worker. 

Job characteristics include duties, working conditions, hours, 
wages, shifts, fringe benefits, and opportunities for advance- 
ment 

Employee characteristics include skills, attitudes, physical 
requirements, educational and training requirements, and 
work experience 
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In addition, current vacancies for placement purposes, potential technological 
changes, such as the introduction of new machines or products, and the employer's 
recent experience with graduates should be discussed. In our judgment, bringing 
a forecast to the employer, obtaining his ideas on its validity, and discussing 
how vocational education can meet his particular needs, will result in a higher 
level of rapport than exists currently. 
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APPENDIX A 

CONCEPTUAL DIAGRAM OF MANAGEMENT INFORMATION 
SYSTEM FOR VOCATIONAL EDUCATION 
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APPENDIX B 

SOURCES AND DERIVATION OF OKLAHOMA OTIS COST ESTIMATES 
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SOURCES AND DERIVATION OF OKLAHOMA OTIS COST ESTIMATES 



This appendix presents the estimated cost of developing and operating 
OTIS in Oklahoma. The sources, assumptions, and derivation of these costs 
are presented in the following five exhibits: 

OTIS Oklahoma Development and Operating Costs 
Cost of OESC Demand Data Collection 

Calculation of OTIS Demand Data Collection Costs for Fiscal 
Year 1972 

Calculation of the Supply and Follow-Up Subsystem Costs 
Calculation of OTIS Annual Operating Costs 
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EXHIBIT B-I 
EcOBomic Developtneat AdmbUstxatiot^ 

OTIS OKLAHOMA DEVELOPMENT 
AND OPERATING COSTS 



DEVELOPMENT COSTS 

(1) Demand Subtystem 

(2) Supply Subsystem 

(3) ~ Interface Subsystem 

(4) Follow- Up Subsystem 



Total Develupmem Costs 



$203, SOOi^ 




QFERATING COSTS 

(1) Demand Subsystem 

(2) Supply Subsystem 

(3) Inter&ce Subsystem 

(4) Follow-Up Subsystem 

Total Operating Costs 



$ 58,3262/ 
9,764^ 
2,500 



$ 70 , S£K) 



Notes? V This f!gm« was obtained from Dr* Wartwi Edmison, DJreWor, Oklahoma State Uttivewity Research 
Foundation. The amount is comprised of a grant to Oklahoma Statse Uniwaity for $153, 500 fpom 
various federal and state agencies and $50»000 for computer time and other related expenses. 
Funds were provided by: 

DOl--$99, 390 

Ozarics Regional Commfcsion— $40,000 

Oklahoma industrial Develotmient and ftiA Department— $34,863 

The remainder of the $203, 500 was comprised of stafif release time fcom the State Department of 
Vocational and Technical Educaticm, OESC> and Private Schools Association. 

2/ This figure is the OTIS share of tiie tcrtal OESC demand data collection costs of $102, 574. The 
OESC data collecticm costs ate detailed in EadWhit fr-H. The derivation of the OTIS shaie is 
explained in Erfiiblt B-IIL The calculation of annfJii operating costs is explained in EiAibit B- V. 



3/ Student Accounting System costs aie $30, 112, as detailed in Erfiibit B-IV. SuRjly subsystem and 
follow-up subsystem costs are estimated to total $9,764. 
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EXHIBIT B-II 

Economic Development Admialsbation 

COST OF OESC DEMAND DATA 
COLIECTION • 



Ficcal Year 



Ifettopal Services 



Benefits 
Supplies 

Coininunications 
Trawl 
Equipment 
Ptemiscs 
Services, Other 



Subtotal Expenses 



Total Expenditures 



Cumulative Expenditures 



1972 



$ 63.867.02 

$ 17,261.49 
975.29 
601.26 
10,253.47 
5, 542. 76 
3,605.41 
467. 78 



$ 38.707.46 
^02.574.4« 



1973 



5.125.84 



$ 1,391.39 
86. 81 
121.84 
21.01 
151.83 
452.93 
105.78 




$ 102.574.48 $ 110^03 1. 61 



1974 



1^ 



1/ 



1975 



1^ 



ll/ S 4.984.191/ 
i. iis,nis.fi i $ 120.000.00 



Sources; State Dcpartmcut of Vocaticqaal 
and Technical Educatim 

Office of Community Affairs I 
and Planning 

Oklahoma Employment Security 
' Commission 



$ 40»000.00 
20,000.00 
42,574.48 



7,457.13 



4,984.20 



4,984» 19 



Total 



$ 4.984.19 



Swsce: Mr. Wayne Edge, Compttollcr» Oklahoma State Employment Security Commission 

Notes: U Utoexpcnded balance for coming fiscal years 

2/ For a description of this pcoject. see Esdilbit B^IIl^ Note 
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EXHarrB-m(i> 

Economic DevetoinaeBt AdmSaUtxatfoa 

, .. - ' CALCULATION OF OTIS DEMAND DATA 

. . :. - , ' COLLECTION COSTS FOR HSCAL YEAR 1972. 



I. Total FY '72 Expenditures ; $102,574,48 



!I. 


Total Employers! 


Units Surveved 


l^etsonal Visits 


Respomes 




OTIS 


2,636 


1,087 


1,865 




OCAP* 


1. 475 ** 




1.097 






4^ Hi 


2.495 


2.962 


III. 


Percentaftc of OTIS^OCAP: 


64/36 


44/56 


63/37 


IV. 


Estimate of OTIS/OCAP Field Data Collection: 







I. Field Staff Costs 

il) P&rsonal Servicgs 

• 11 Graduate Snidents © $520/ month x 12 weeks 
« 2 ES Psofessional Staff ^ 1 and i months ^ 

$600 and $750, respectively 
» Benefits ^a> 20^^ ES staff only 

• Clerical Support (estimate) 

Estimated Total FersonUt-Srfvicefi 
(2) Other Tha: Pctsonal Services 

• Travel and Per Diem Expenses 
, Mailing (estimated 2800 pieces @ 24<t each) 
. Communicatims 

Estimated Total CXhcr Than Personal Services 



$ 17,160.00 
2,850.00 

570. 00 
4. SOD. 00 



$ 2S,0SO.00 



$ 10,253.47 
672.00 
601.26 



11,526.73 



Total Estimated Expcndittires for Field Data Collection 

2. Estimate of Field Cost Distribution OTIS (44^^) 

OCAP iS6%) 



S 36,606.73 

$ 16,107 
20,500 



V. Estimate of OveAead and Project Manai^ment Costs : 

1, Total Expenditures 
. 2. Total Field Cost Estimate 

Total 



$ 1(K, 574.48 
36,607.00 

$ 65,^7.48 



Note: ♦ OCAP ; Office of Community Affairs and Hannjng of (Sdahoma. This survey was conducted simultaneously 
witfi the OTIS survey, and the entire effort was treated as a single data collectico pioject. However, Ae 
OCAP pioject will not be repeated. Thus, OTIS expenses, in terms of future costs, shotUd be separated* 
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EXHIBIT a- 111(2) 



VI, Eatimated Distribtttion of Qvethcad and Project Management Costs ; 

1, Estimated OvcAead and Project Management Costs $ 65,967»48 

2. Estimated Distribution ^ OTIS (64%) $42,219 

OCAP (369$) 23»748 

VTU Oklahoma OTIS Demand Cast Estimate : 

U Field t^ta Collccticm Cost Estimate $ 16,107 

2» Ovexheiad and Piroject Management Cost 42^219 
Estimate .._*.p^ 

Toul OTIS Demand Cost $ 58>326 



Souxce: Demand Cost Estimates arc based on data and assumptions developed in conjunction with Mr. WUIiam 
Hunter and Mr. Wayne Edge of the Oklahoma Employment Security Commission. 



EXHIBIT B-IV 

EcOBomic Development AdxnSnistxatta 

CALCULATION OF THE SUPPLY AMI 
FOLLOW-UP SUBSYSTEM COSTS 



K Annual 3luUcnt Accoimttefg Sv>tem Co&o 

(1) Administrative Pesscmnel $ 6,000 

(2) Teacher Time~2 hours: 30 minutes {Enrollment Completion 9,000 

and FoIlow«Up): 1800 teachers $5, 00/bour . 

•i 

(3) SAS Personnel (Full- Time) 8,000 
. Additional Help 390 
. Travel 1»716 

(4) Computer Time— 26 hours $35/hour 910 

(5) Keypunch— 100, 000 cards <^4<t/card 4,000 

(6) Interrupt Card (completion of Follow- Up>--24 houis <^ $4, 00/hr* 96 



Total 

2, Allocation of Supply and Fo11ow**Up System Costs 

( 1 ) Supply Subsystem 

(2) Follow- Up SubsyslE^m 



$ 9,764 



HEsr Cjrv 



EXHIBIT ft-V 

Economic Developsnent Adminlstxation 

CAIjCUUTION op OTIS ANNUAL 
OPERATING COSTS 



1, Demand Subsystem Co st s 

(1) FY 1972 Baseline 

(2) FY 1973 Up<J»te 

(3) FY 1974 Update 

(4) FY 197S Update 

Divided by 4 yean 

Demand Subtotal 

2, Su pply and FbUowf-Up Subcvitem Cotts 

3, Interface SnbswtcTO Co<rt» 

Total Annual Operating Costs 



$ 58,326 

7,457 

4,984 

4,984 
$ 75,751 



\ 



$1iB,938 
9,764 
2.S0Q 



APPENDIX C ^ ; . 

SOURCKS AND DERIVATION OF KENiUCKY OTIS COST ESTIMATES 



mc 



APPENDIX C(l) 



SOURCES AND DERIVATION OF KENTUCKY OTIS COST ESTIMATES 



This appendix presents the estimated costs of developing and operating 
OTIS in Kentucky. The sources^ assumptions^ and derivation of these costs 
are presented in the following two exhibits: 

Derivation of Kentucky OTIS Cost Estimates 
Letter from Dr. Janie L. Jones 



EXHIBIT C-I 



Economic Development AdministvittfiC 

DERIVATION OF KENTUCKY OTIS 
COST ESTIMATES 



I. 



DEMAND SUBSYSTEM 

1. Development Costs 

(1) Contractual and Consulting Services 

(2) Computer Progrom Development 

(3) EDA Personnel Support 

Subtotal 

2. Operating Costs 



(I) 
(2) 
(3) 
(4) 
(5) 



Management Personnel 
Field Pejsonnel 
Travel 
Supplies 

Computer Support 



Subtotal 



Total Demand Subsystem 



II. 



SUPPLY AND FOLLOW'-UP SUBSYSTEMS 

1. Development Costs 

{ 1 ) Student Accounting 
(2) Follow-Up 

Subtotal 

2. Operating Costs 

(1) Personnel 

(2) Supplies 

Subtotal 



$ 68, 697 -i^ 
14,500-1^ 



27,768-^ 
70,088-^ 
9,'XX)--^ 
1,000-^ 
2.500- 



5/ 

~" 6/ 
22.694 - 



$ 41,690A^ 
10.200 ^^ 



III. 



Total Supply and Follow-Up Subsystems 
EDUCATIONAL RESOURCES SUBSYSTEM 

TOTAL COSTS 

. Development Costs 
. Operating Costs 



$ 101,997 



110.356 



$ 212,353 



$ 22,694 



51.890 



74,584 
23, 180 



$ 310.117 

$ 124,691 
$ 185,426 



Source: U Exhjbit C-II, copy of a letter from Dr. Janle U Jones 

2/ Estimated by MSI based on two man-days per weelt on-site 

1/ Letter from Dr. Janie L. Jones includes $51,426 for costs of field surveyors to conduct only the 
census of manufacturing cmployere, i. e. , subsequ«5nt employer stirvey costs are not included 

4/ Sti mated by Mr, Dave Portcb of EDA Information Systems and Services Division 

5/ No developmental costs for tBe Student Accounting System are included because tJje system was 
« developed previously. 

6/ Includes only Kentucky's share of tlie cost of an EDA contract with C»io State University; total ^ 
costs are appcoximatcly $100, CCO 





EXHIBIT C3-II(1) 



Economic Development Adxntalstxation . 



BEST 



LETTER FROM DR^ JANIE U JONES 



COMMONWCAUTN Or KENTUCKY 



Brjjartmrttt of ^ntafuxn 

BUREAU OF VOCATIONAL EDUCATION 



rnANKFC T 4MOt 



August 3, 1973 



Dr. Wlllian J. Tobin 

Economic Development Administration 

Program Analysis Division 

14th Street and Constitution Avenue N»W» 

Washington, D. C. 20230 

Dear Dr. Tobin: 

I have gone through the cost estimates for Kentucky again, and I also 
asked Mr. Hume, Director of Fiscal Control and Financial Accounting, to 
look at it* 

In addition, 1 am sending you a copy of the notes I made on the Oklahoma 
costs ♦ I realize this has been revised and that some of these things may 
have been considered in the revision. 

As I told you on t^^e phone, here in Kentucky we feel that the benefits 

to be derived from the system are much greater thin just the obvious ones. 

1 hope this will help in getting the disagreements worked out. If I 
can be of further help, please call. 

Sincerely, 




Janie L. Jones, Director 
Occupational Information Unit 



JU/ew 



Enclosure 



EXHIBIT C-nC2) 



R£KTUCKY*S INFOmxiON FOR TRAINING AND EDUCATION SYSTEM 

COST ESTIMATES 
• August 1, 1973 



1. Demand Component 

(1) Coordli4itor (full time) 15,288 
Secretarial 4,740 
Director (k time) 4,014 

24,042 

Benefits d 15.57. 3^726 27,768 



(2) Field Staff 

Industrial Coordinators 10,827 
Secretarial 5 . 33 i 

16,156 

Benefits (? 15.5% 2,504 18.662 

TOTAL PERSONAL SERVICES 46,430 



(3) Travel 

Industrial Coordinators 4,500 

Field Surveyors 4. 500* 9,000 

(4) Supplies 1.000 

TOTAL OPERATING COSTS (Demand) 56,430 

♦If salaries of field surveyors are included, 

an additional $51,426 should be added (55.926 - 4,500) 

making a total of $107,856. 

(5) Project Developmental Costs ^ 

Computer pr.o^rav. development 1^,500 

Contractual and Consulting Services 68 ^ 69 7 

TOTAL DEVELOPMENTAL COSTS (Demand) , ^3«197 

TOTA.L COSTS (DEMAND) 139,627 

II, Student Accounting and Fol low-Up System 

(1) Coordinator (full time) 11,412 
Secretarial 4,512 
Director ii time) ^,01^ 

19.938 

Benefits f? 15.5% 3.090 23,028 

(2) Industrial Coordinators 10.827 / 
Secretariijl 5,331 , 

lh.l5a/ 

Benefits -15.57. 2.50/ 18.662 



EKHSIT C-IK3) 



<3) Supplies 10,200 

TOTAL COST (SUPPLY & FOLLOW-UP) 51,890* 

♦The $22,69^ charged to Ohio State was not an . . _ .._ 

expenditure, for Kentucky. This lamounT 'wasr"recelved 
from Ohio State in support of the follow-up. 

Ill, Educational Resources 

(I) Coordinator (full time) 16,056 
Director ik, time) 4.014 

20,070 

Benefits @ 15.5% 3,110 

TOTAL COST (EDUCATIONAL RESOURCES) 23.180 

TOTAL OPERATING COSTS 131,500 

TOTAL DEVELOPMENT COSTS 83.197 

214.697 

Total Costs Annualized for a 5 year period: 

Operating Costs (131,500/year for 5 years) 657,500 

Developmental Costs ^ 8 3,1 9 7 

Total 5 year operating and developmental costs 740.697 

Costs Annualized for 5 years 148.139 

Prepared by: 



Janie L. Jones, Director 
Occupational Information Unit 



SAMPLE OKLAHOMA AND KENTUCKY QUESTIONNAIRES 




KENTUCKY QUESTIONNAIRE 



St 



#» 




itvey Number: 27 



Report on Occupatfonal Employment 
PRINTING and PUBLISHING Industry, 1972 

KENTUCKY MANPOWER PLANNING COUNnL^ 
BVREAlf <«*-VOCtTtO?ri«rH)UCATION 



BEST copy mmii 



OCCUPATIONAL EMPLOYMENT SURVEY 



Report No. 



Address Label 
to be placed here 



THIS INFORMATION WILL BE MADE 
AVAILABLE TO VOCATIONAL EDU- 
CATION AND OTHER AGENCIES FOR 
MANPOWER PLANNING, CAREEH 
GUIDANCE. AND CURRICULUM 
CHANGE PURPOSES. 



Change address if incorrect 



General Instructions 

REPORTING UNIT: Complete this report for your company operation (Reporting Unit) identified on the above mailing I^Hel 1 c> 
help multi-unit employers correctly identify the Reporting Unit, its physical location has been printed in the lower portii^n of 
the label and our estimate of its total employment appears as a six digit number in the lower right hand comer of the label < Multi- 
unit employers may rcccive^ questionnaire forms for more than one Reporting Unit). 

REPORTING PERIOD: Report information for a payroll period that includes May \2, 1972. If, because of unusual operational 
problems (e.g., work stoppages, temporary shut-downs), the May 12 period is not a typica! period, please report for a p<-noJ nvar 
, est May 1 2 in which operations most closely approximate the normal. 



PARTL GENERAL INFORMATION 



I. TOTAL EMPLOYMENT 



(9m) 



Enter the total number of persons on the payroll covered by this report who worked full- or part-time or received pay |Dr any part 
of the period reported. Include salaried officers of corporations and executives and their staffs, but exclude proprietors, members 
of unincorporated firms» and unpaid famUy workers. Include persons on vacations and sick leave for which they receivrd p:»v AirecU 
ly from your firm for the ptriod reported but exclude persons on leave without company pay the entire period and pen^iont rs and 
members of the Armed Forces carried on the rolls but not working during the period reported. 

2. NATURE OF 8USINESS 

(a) Describe the principal activity and the major product or service of the Reporting Unit (e.g., Manufacturing-women\ shoes; 
Warehousing-steel products; Rcsearch--radio and T.V. receiver; and RetaO tradc--shoe store). 



<b) Is the Reporting Unit primarily engaged in performing services for other units of your company? 
If •'yes** please check the one block below that best describes the service being perfomrcd. 



Yes □ D 



(I) Central administrative ofHce 

(2> Q Research, development, or testing 



(3) Q Storage (Warehouse) 

(4) [J Other (Specify, e.g., powcrplant) 



S. STATUS OF ACTIVITY • PayroU period that includes May 12. 1972, 

If the reporting unit did not operate under your manag/^ment during the May 1 2 period, please check the appropriate block below 

Q This unit has been sold or merged. New name and address is: ^ . 

D This unit is out of business. ^ 

□ Other (Describe) — ■ — — 

4. If questions arise concerning your report, whom should we contact? 
.5S^ Mr. 

'^ (Sr*^ 



Name 



Title 



City 



State 



Area Code 



ick . No. 



PART II. REPORTING INSTRUCTIONS 



BEST COPY AVAILABLE 



The occu|»at$ont iiited in Pirt II of tfHs form sre ffouped info bro»«l fum tkknsi categories ind include most of the joht thst 
arc likely to be found in the Rtportlnf Unites type of oi^rttion, Some of the listed occupations will not be found in every 
estabtishment of thii type. 

Pteaie review the broad categories for an uveralt view of the kcnd^ of occupations we are studying. Definition"^ ot specific 
occupations within a group are provided in the enclosed '•B4»*»klet iif l>efinition\ " (IVfinitlons ate rresented in •'Oet^inition 
Number** order. t'%e the Detinitum Number thjt appcarsin colunwi (I ) tocasiH locate the definiti«>n f«»r .oiy listed <»ccupation.) 
Subtitles, shown in parenthesis, may follow some occupational tttlen. these represent manv but n«>t allot the different titles 
employers iumettmes use for these occupations and are shown fe>f itlustrutKe purposes only 



Report each of your employees in one or the other of the listed oivupations or .ALL OI HHK cateporios Dm im report 9 
worker tn more than one xcupation 

Employees ot the Reporting Unit should be counted m the mvupath»nN U\U\\ in P.irf l\ ot ihi^ t.irm a ••Working bjsis 
as of the date ot the report, regardless ot the occupationjl field m which they received thou tr;iininp. Wn v\:!inpk\ an 
efnpli»yee trained as an engineer but working as a mathematician .k i^t fhc date ot uk- fcpnrt should he ci^untcd a 
mathematician. An employee whow job duties cover more than i>nc «»• nu« hsicd oivupaoonv should Ik ^^umUcI in the 
(H.cupatK>n that, m your opinion, requires the highest level of skill. 

- Fmp<o yecs who were absent without pty during the period hctm nportcd ti,e.. short term ahwnccv ti-xuUmp Irom 
mne!»^, bad weathet . temporary layoff, jury duty) should be included m the ^Hvup-ttmnaUounts. 

Wofking Foremeji tthose spending 20% or more of their tmu' at tavks vinular to tho,i- K-um pcrtotmcd bv wi>rkcrs 
under their supervision) should be counted in the occupatum movt ch^sely li Uied to thur work dutK\ u .r. . a working 
foa'man in an inspection depautmcnt should be counted as an 'InvpccUH *). 

- Fart-time Workers, Legmegi;^ and Apprentices should b*- i >unfcil ux thw iu,upation w y\hwh thcv ordini»:h perl«»nn 
Itheir work. 

- Clerical Supervisors should not be counted in any ot the specilu «»CiupatK»ns Insto.id, thcv should lv..Hinit'4i n\ the 
most appropriate ALL OlHiR category <c.j«., a Payroll Suinrvisor* sho-ikl W vountod in ih» M I OIUI R Ottue 
Clerical Worker Category). 

- Owners and partners of untncorporatiui firms and unpaid tamily wurkcfs slu»uU1 W l^ tN ii tuMu ilus up».rt 

« 

Include in this rept>rt, company personnel who pcrlorm their vviuk tlutics at • r 'Nmt of the rep<»rting unit \ r. who. tor 
administrative reasons, are carried on payrolls ol other units o\ v»«or ioinj>.ipv I .r , a m <r.ivrltn^? vilcsnu n « f i.ist.tmcr 
scrvtce personnel who work "out oP* the reporting unit should he inihuted in vour p<»ft ivcn th«»ueh these personnel may 
be earned on the rolls of another unit of your company. 

Reasonable e stimates of the number ot workers you emph>y tn an ik:c jp atton are a^^cp tabic. 

Descriptton of Column Headings: 

Column <3): This column is headed 'TOTAL" and appears for rvery occiipanon. ^nter in this cnlitnin the total 
number of workers you employ in the listed occupations li ihis is rotisuUtcd a criti. ai shortage 
occupation, please circle the definHicm number 

Column <4): This column is headed "Apprentice'* and appears only with the "Mamtenaitce. Consiruction. Repair 
and Powerplant'^and selected "Prodwction < plant occiipntions Tnter m this column the niimhrr of 
apprentices, already reported in column that vou emt»lo\ tn jny of these occtpiitKins < Set* defi- 
nition of apprentice on page 2 of the **BiM)kief of Pfiiniti«»ns.") 

Column tS) This column is headed "R & D'' (Research D. sehipment » ;»rt«f iippr.v* only uith ^cuntifk and 
technical occupations. Enter in this cotuniii il>r nitmhpr vsorMr--. aUeadv i.p jrtc«i in o'lumnlJ). 
^ho are working primarily in research and de\»'l«»pnM i.i t jiu Si r dt ♦uUnn vf r« carch and 
development on page 2 of the "Booklet of Dehmtnms. 

Columns (6) and (7) 

Enter your estimate of the total number of vour workers m rcportuiK y<>" enpc* f tn h<»ve it} 
June, 1973. and in June, 1974. Assume. n)a4' nafi »njtl niun^ploytMcnt rate. (2) your cirrent plans 
for enpansion or modernization will materials/** ;ucordin{f tn v. hedtilc 1 3)scientitic and tcchiii>loulcal 
changes affecting production methods, m^npouet rc^nirtincnts. and imsumplton patterns will con* 
tinue according to industry expectatitmv and <4i ihi- normal houHy workweek tt vour eM.ihlishment 
will continue through the forecast pe riod. 

The sum of the column (3) counts should be approximately equal to the -It) I \l ^ vp: oYMf \r' reported in Part I of this 
form. (These may differ sUghtty because column (3) data may incUule ciupiovccs A\ slmtt urm abveniv without i ly ) II you 
do not employ anyone in a particular occupation leave column i 'd.iPK 



SAMPLE ENTRIES COPY /li/^|yjgj[£ 



(II 



(2^ 



R«fMltr «iidl Powet Ptftfit 



Total Hct 

13) 



5" 



s carpenters are cmpU^ycU Ttif the is an "apprenucc." 
.1 electrii ians arc cmphweti. N^me arc apprentices. 

S noni^orKini; foietieei ire employed m "PnKiuciton tPlant> iHTiipi»«»»*ns * 
t ^^i ihc IN the i«xpei?i»*n iJcpartnient foreman li) inspectors are e>^ftk»rci! 
I IS .1 working ' fi»reman ;in«l ! is a "learner;' tMutnn '41 mformaiMvn, 
im .tppfcnitces »v not tvK\Kiu\:i\ for these occupaiums. 



INffpt 

ttfHI 

III 



ill 



»ittU ffs 



I3» 



R&t> 

(5t 



" !>«in;*i!«"rs i»n*.1 officers .irr .•f.»p|..vc»1 ; of thosf mMn;«t;c cnc'necnnjj 
actfvtticsam! 5 tsfhf*map;tgcf of !h»- unit's chemical anatvM^i licpartment. 
The rematnin>! I are mm terhniral f<%»ntrotlfr. Sales Mi?o , tt. .) ani< are 
repi»rie<i in the Ml OIMI R Latf^»ot>. I of the eP>tincc»N iv '•nf!a«efi «n 
reseirch an*! tlevelf»pment icitvttics 



Srtet*tHf. 

Mr* h -rtK-..! efi>KH»«'«'T 
1 1, fu al an.t cto* rr.^n- 

Chcntu ,1* cn^ineef 
All *>T*U R etviiuv's 



5* 



H cnpinef>s ;nc cmpUncd in. t oMintinc Managfrs ami Officers!, 7 of 
these *ork in specifically listed engineering tK-cupstions. 1 he remaining 
enKineer is a "Mining Knginccr." an occupation m>t specifically listed. 
«nrf« rep.>rtcd in the ALL OTHER category. 2 of the 5 mechanical en 
gineers arc engaged tn research and development activities 



Defmi- 

tiun 
number 

(I) 



Occupations 
(2) 



ToUl 
(3) 



Expected Expected 

Employment Employment 

in in 

June June 

1973 1974 



TECHNK AL OCCl'PATIONS 



Engineering Technicians 



Drattsman 



/3 



n 



10 draftsman were employed as of 
May 1972. 13 are anticipated for 
June of 1973 (a net increase of 3) 
and 17 by June of 1974 (a net in- 
crease of 7) 



PART II EMPLOYMENT BY OCCUPATIONS - PRINTING & PUBLISHING INDUSTRY 



F^ST COPY ;;jr.:L^ri£ 



Defmition 
number 

(1) 


OccuDation 
(2) 


Total 
(3) 


Expected 
Emptoymene 
In June. IQ73 
<6) 


Expected 

timploymrnt 
In June. t9''4 


1.000 


EMPLOYMENT IN ALL OCCUPATIONS. TOTAL 








:.ooo 


MANAGERS AND OFFICIALS. TOTAL _ 








3.000 


PROFESSIONAL AND TECHNICAL WORKERS* TOTAL 








3.010 


• 

Accountants and auditors _ 








3.020 


Commercial artist (illustrator, editorial artist, art layout 
man) 






> 
■ 


3.030 


Commercial designer (bank note, book cover, form 
designer) 








3.040 


Engineer (electrical industrial, mechanical, chemical 
engineer) 






1 


3.050 


Estimator ^ 






^ 

i 


3.060 


Mathematical scientist (mathematician, statistician, 
actuary) ^ .„ 






1 
1 


3.070 


Natural sicentist (chemist, physcist, biological scientist, 
geologist) 






i 


3.080 


Personnel and labor relations specialists (employment 
interviewer, job analyst) 








3.0<>0 


Photographer ^ ^ , ^ 








3.100 


Purchasing agent ' 








3.110 


Social scientist {economist, political scientist, pyscho- 
iogist* sociologist) 








3.120 


Systems analyst, electronic data processing 








3 130 


Writers, editors, and reporters (copy writer, rewrite man, 
deskman. advertismg editor) ^ 








3 140 


All other professional workers (physician, lawyer, archi- 
tect, professional nurse, reference librarian) 








3. ISO 


Technicians 








3 15! 


Computer propramer ^ ^ ^ ^ 








3 152 


Draft&man „ ^. , , . „„ 








3 153 


Kiectncal and electronic technicians ^ 








3 I.S4 


All other technicians ^ 








4.000 


SALESMEN (ADVERTISING, CIRCULATION. BOOK. 
PRINTING SERVICES SALESMEN) 








5 000 


CLERICAL WORKERS, TOTAL 








5 OtO 










I 


• 









BEST COPY AVAIUIBIE 



PART II EMPLOYMENT BY OCCUPATIONS - PRINTING & PUBLISHING INDUSTRY 



Definition 
number 
(I) 



5.020 
5.030 
5.040 
.5.050 
S.OftO 
5.070 
5.080 
5.081 
5.082 
5.083 
5.084 

5.090 
5.100 
5.110 
5.120 
5.130 
5.140 
'5.141 
5.142 

5.143 
5.150 

6.000 



6.010 
6.020 

6.030 
6.040 
6.050 



>Y2 D f ^^"^ 



Occupation 



Bookkeeper 

CaNhicr ^ ^ — ~ — — — 

ClaHMlicd-ad clerk, newspaper 

Correspondence cterk — . — — .. „ , „ 

C'u<^tomer service representative (customer liaison man) — 

Oltke machine operators, total — 

Billing and/or bookkeeping-machine operator 
Digital-computer operator (computer console operator) 
Key punch operator , 

All other ottke machine operators, ( calculating. 
^ duplicating, tabulating machine operators ) 

Payroll clerk ^ 

Personnel clerk 

Procurement clerk ( purchasing clerk ) 

Telephone ad-taker, newspaper 

Telephone operator (switchboard operator. PBX operator) 

Secretaries, stenographers, and typists, total ^ 

Secretary 

Stenographer , 

Typist (clerk -typist) . 

All other clerical workers 



Total 
(3) 



PRODUCTION, MAINTENANCE. MATERIAL MOVEMENT, 
AND POWERPLANT WORKERS, TOTAL 



APPRENTICES 

( £xchdt fewiefs and hefpen ^ 



Apprentice bookbinder 



Apprentice compositors and typesetters (hand compositor. 
Lmecasting-machine operator, phototypesetter opera- 
tor) 



Apprentice electrotyper 

Apprentice etchers and engravers, except photoengravers 

Apprentice lithographic preparation worker (cameraman, 
platcmaker, :itripper) ~ 



I m ploy men! 



In June f»"4 



-5? 



PART II EMPLOYMENT BY OCCUPATIONS -PRINTIN{;& PUBLISHING INDUSTRY ^^ox ^QpV AV^^^^^^ 



IKlinttion 
number 



louil 



u I M) 
I HO 

:4o 



oUsvi-hthnfrapluv prcsHtnatu ^ — — — — 



\pprcnticc stwTOlv por 



Apprcnttvcs. at! tilhor pnnttni! fruits «m.nUT. swrci'i^ 
printor > ^ 



ApprcntKfs. jll otIuT (kiafru t.tn. tH.Kiiin»N|. sr;inoM»!rv 
^ nUMU'CJ > , 



C OMPOSIM. ROOM 0( ( IT \1 IONS 



( t^pV I Utt^T I . i»p\ > ... 

H ituJ t<>mp«wr!t»r ^ * ^ ^ ^ 

IfiiposwrN in ! JM.iki'Hp iHi'i* ki»p iiKtM. sUtiu* iKuui* 

I mr» jvtitij! m.u^hnu' <»pi'rjtor < lwu»tN pr <»p.'i;ttot. mK'f • 

f\p' »»p ' itt^rt . 

I nUiMstiML* rn.ultnu* kv^hivni opv*r<it<»r nv*U*t\ pcM tti i 

pw^rfor.itor c^vnttor* ^ ^ 



!noti!tor> ^ 



I iulitm*ni.khiiK' t»p* r.iior \ lutMN p. »pi'r.iton ^ ^ 

Mark-up niii?) ^^^^^^ ^ ^^^-^^--^ — 

Mt)t)oiv pi» - i.astM!^ iiuw innc t>pv ^^t<»r ( nw»n«Mnattt cjnIc? ) -.-^ 
MoitoTv pi»-kc> Nf^ard opcraloi inionotvpt* kcvlutafi! opt t.df^ri 

Pasti'up n>an — . — — — — . 

Ph<>t(*ii'tt». Mnv» THac fiMK- opi»r ,h»r ^ , 

riiototv pcswitme-nKuhnii' kv vbo.iui «»pi*ratoi (pliot^v 

^raphu ki \ boaril opi fator > ^ 



oprratnrJ 



Phototvpo scflw f <>por.t{or4pIu>U)i:fjplMu s\stcm opcruU>r> 

Prolyl fi'advr. ctMi^'^ovm^* wo*\\ ^ — ^ 

Stnki'-<>n !?U!thtnc t^^rator 



LITHOGRAPHIC - PHOTOMECHANIt \L 
PREPARATION OCCUPATIONS 



AflJst (ri»touri.hrf. dot ctcluT» Ictli ftTriolor ctwhcr) 



BEST COPY mmii 

PART II EMPLOYMENT BY OCCUPATIONS - PRINTING & PUBLISHING INDUSTRY 



Dctlnitton 
nuntbor 
(II 



b.310 



6.330 
'».34() 

6.350 

t>.3<>0 



6. 3^0 
6.3S0 

6.3*»0 
6.400 

6.410 

6.4:o 

6.430 



6.440 

6 4.';o 

6.460 



ERIC^ 



Occupatiini 
{2) 

< '.inu'f.nn.itt Ui>p\ i.itnv-r.iin.in. photo lithographer, fuh- 
unw camoram. • , 

IK'\w*iupcr u^irk rouiu m^m) 

PlatoJiKikcr ( press platcmakcr. transterreri 

Stripper 



OTHi R PLATLMAklNGOCttPATIONS 



I U\.trutvpcr (ekvtrotN pc waster, eteetrotype nuMder^ 

I tch. rs ami erti^ravi-rs. except photoen^ravers ( panto- 

urapher. Mvierographer. steel die mgraver. letter engraver) 

PhotoeTigraver (canu-rarnan. printer, eleher. router, bloeker. 
tnnsher^ . 



Stereotv per 



PRESSROOM OCCUPATIONS 



I lexot'raphi* prvsMnan 

<ir.iviiu- presstr.afi. rotogravure and sheet led — ^ — 

I etter pressman, sheet ted and roll IVd u^eb fed) 

Lettersel pn'ssman (drv oflscf. indirect relief), sheet ted 
aitii roll ledfvvehled^ ^ — 

Ottset !jt!u»|.'rapluL pressman sheet fed and roll fed (wvh 
Ved^ ^ 

Steel die pressman (du* stampmg. steei die embossing press- 
n?^.*n> ^ ^ 

Pfess assNtafits and leeders — 



SC Kl tN PROt tSS OCCUPATIONS 



Screen cutter CsU titil cutter. Iilni cutter) 

S*.reenniaker. photographic process 

Screen printer — — — 

BINDING. MAILING, and SHIPPING OCCUPATIONS 

ft 

Bindery machin«r '•etup man ^ ^ 

7 



Total 
(3t 



In luiu l*» ' t 



PARTH EMPL0YMEJ4T BY OCCUPATIONS ^PRI^n^ING A lOJBl^^ CO?V IWrVX^Blt 



Deflnition 
number 
(1) 



Occupation 
(2) 

Bindery worker (bindery hand, hindcry man or woman, 
table worker) „ 

Boi^kbmder ^ 

Delivery man ^ 

Mailer 

Routeman, newspaper (route supervisor) 

Shipping and/or receiving clerk 

Truckdriver, light or heavy 

CONSTRUCTION. MAINTENANCE. REPAIR 
and POWERPLANT OCCUPATIONS 

Carpenter 

Elecrrician „ ^ 

Machinist (composing room machinist, press room 

mac hinist ) ^ ^ ^ . 

Mechanic, automotive ^ 

Mechanic, general 

Mechanic, maintenance 

Mechanics ard repairmen, other 

Plumber and/or pipefitter 

Stationary engineer ^ 

ALt OTHER PRODUCTION. MAINTENANCE. 
MATERIAL MOVEMENT, mi POWERPLANT OCCUPATIONS 

Foreman, nonworking — — 

All other skilled craftsmen and kindred workers 

All other operatives and semiskiiled workers (power 
truck driver, inkman. paper conditioner, paper cutter, 
proof press operator) 

All other laborers and unskilled workers (warehousemen, 
press cleaner, paper handler, fly boy, groudkreper, etc.) . 

SERVICE WORKERS* TOTAL 

Guards, watchmen and doorkeepers 

Janitors, porters and cleaner's 

Ail other service workers «^ - 



Total 

(3) 



Expteitd 

it) 



IiiJuaeJ974 



6.480 

6.490 
6.500 

6.510 
6.520 

6. 530 
6.540 



6.550 
6.560 
6.570 

6.580 
6.590 
6.600 

6.610 
6.620 
6.630 



6.640 
6.650 
6.660 

6.670 

7.000 
7.010 

7.020 
7.030 



O 



OKLAHOMA QUESTIONNAIRE 



BEST COPY RVAIUBLE 



5EftV/C£ SCHEDULE 

OKLAHOMA OCCUPATIONAL NEEDS 
SURVEY QUESTIONNAIRE 



Do Not Ut* This Spae* 
Editor Dot* . 



Refurn to, 

Okiohoma State Employment Service 
Research and Planning Diviiion 
Wit! Rogers Memortcl Office BuUding 
Okiohomo City, Okiohoma 73105 

521^3735 Area Code 405 



NOTE Before Entering the Requested Information, Please 
Read the Instructions Attached to This Schedule. 



CODE 


OCCUPATION 


EXCLUDtNG 
TRAINEES 
JUNE W1 


EXPECTED 
EMPLOYMENT 
IN 


NUMBER OF^^tORKlERS 

COMPLETING 
IN. PLANT TI?A{N(NC 
PROGRAMS BY 


NUMBER OF 
VACANCIES 
UNFILLED 
30 DAYS 

/\Q LAf> DC 

On MOKc 


t6TAL 


FEMALE 


JUNE 1973 


JUNE 197 S 


JUNE W73 


iUNg 197S 


n\ 


(2) 


(3) 


U) 


\^ 








(5) 




PROFESSIONAL, TECMHtCAL A WD 
fHANAGBRfAL QCCUPATtONS 

sHi nnn r 
















on|.2HKO 


DRAFTSMAN, ARCHiTFCTl RAl 


















M.F( I RK Al FNGINFKR 
















OOVOHI.I 


ttt:<:TROM<: E^iCINEtR 
















ooi.tst.o 


fcLFCTRICAt TFCMf^KfAN 


















tl.FCTRONIC TFCH^fCfA^ 


















DRAFTSMAN. F LFC TRICA t OR KLt^.CTROMC 


















nvjL fnoi!«f:lr 


















riVrt K\'CjINht.RrNG tfchmcmn 


















DRAFTSMAN, MVfL 


















MFC.HANK-AL FNG^NFLR 
















otr.lHl.o 


MFC KAMK At ENGINF.F RING TU.HNKJAV 


















DRAFTSMAN. MFCMANtrAL 
















OIO.OBLO 


PFTROtFL^M FNOINLLR 


















DRAFTSMAN. GFOLOGlCAt 


















5VSTFMS ANALYST, BUS. FLFC. DATA PftOr 


































Nn-RIAL t.NOlNFKRfNCf TECHNICIAN 


















N^N. MAP 

















091.228.^ 



094,22R.I 



100, 168. 



TFArHFl 



CTOR, Bl S. DATA PRtX FSSINC/^ 



• FSS 



• >ilNO AND 



TFACHFR, 



TF ACHFR. miUJ 



TFArHFR. FlFMf ^ 



OOL 



TFAC HER. SPFCIAL FmirATrON {FLFMFNTARY> 



ACMKR. SPfCfAL FDI»rATIOV (SECONDARY) 



LIBRARIAN 



$2.0W.O COPY »RITFR 



(CONVNUSO ON REVERSE SfOE) 



PAGE } 



prcT COPY AVAIUBIE 



$BRme iCHEDULB (Cent,) 



0. 0. T. 
CODE 


OCCUPATION 


IMPLOTMINT. 
EXCLUDING 
TRAINerS 
iUNE 1971 


(sxprcTeo 

EMPLOYMENT 
(N 


NUMBER or vvORKbRS 

COMPLETING 
IN-PLANT TRAINING 
PROGRAMS BY; 


NUMBER Of 
VACANCIES 
UNFILLED 
30 DATS 


TOTAL 


PFMALE 






iUN0 1973 


JVHt 1975 


OR MORE 




(2) 




C4) 






m 


i$) 






PROFESSIONAL, teCMHtCAL AHO 
MANAGE tIAL OCCUPATIOM^ fCMt*; 

COPY RFADrH OR SCRIPT RFADER 
















H9. 288.0 


»R!TPR. TtCHNICAL PUBUCATfOMS 
















141.061.0 


ILLUSTRATOR, COMMERCIAL ARTIST 
















t4L081J 


LAYOUT MAN {PRINTING AND Pt/BLIStflNC) 
















Ui. 062.0 


HHOTOCRAPHER OR CAMERA MAN 
















S60. ItS.O 


ACCOUNT AIVT 


































}6f.oaro 


PUBLIC RELATIONS MAN 


















PERSONNEL DIRECTOR 
















}6$. I6t.0 


CREDIT MANACER 


















MANAGEMENT TRAINEE 
















20t.)6M 


CLgmCAL ANO SALftS OCCUPATtOHS 
SECRETARY 
















202. MS. 0 


STENOGRAPHER 
















20$.)6«.0 


PERSONNEL CLERK 
















2Q9.|t8.0 


CLERK-TYPIST 
















210. 


BOOKKEEPER. HAND 
















2tl.96ft.O 


CASHIER 


















CARD-TAPE CONVERTER OPERATOR 
















21 3. 5^2.1 


DIGITAL COMPUTER OPERATOR 
















JtJ.W.O 


key-p«.mVch operator 
















2H.7i2.0 


TABULATING MACHINE OPERATOR 
















215. m.O 


BOOKKEEPING MACHINE OPERATOR 
















2t5.4S».0 


PAYROLL CLERK 
















SQfi n 




















A^ABAi^A ^V^^PA€t 

PROGRAMMER. DETAIL 


















ACCOUNTING CLERK 


















TELEPHONE OPERATOR (P. B. X*j 


















CLERK 
































NcDRJVER (ROUTEMAV) > 

V — --r 














H2.2TL0N 
y59.S?8.0 


















972.S68,0 


srcK^ \. 














cusToi\^ >s • 














407.W4.0 


okolndskV^ 
















4M.(M10 


GINNKH X 


















LIVl.STtX K CARJ\,,X€^» 
















«l.?R2,0 


PmOQtSimO OCCUPATIONS 

CRtNDI H Oin RATOH CCRAIN AND 1 FKD MILD 


















HAKhR 

















(CONrmMPMPACM l> 



BEST COPY AVAimSLt 



SERV/CE SCHEDULE fConf.) 



Do Not U»« Thii Si:ac« 



r 



Okiqhomc Stote Employfnent Sefv»ce 
Research ond Phnr ing DfvisiOrt 
Will Rogers Mem^riol Ofticc Building 
Oklohomo Gty, UkluKoma 73105 
521 -S??? A ?Kj Code 405 



MOTE: Before E«termg the Requested Information. Please 
Read the Instructions Attached to This Schedule. 



DOT 
-CODE 


OCCUPATION 


Employ 

£XCLU 
TRAIN 

^OtAL 


MENT. 

DING 

EES 


EXPEC 
EMPLOY 
IN 

JUNE 19?3 


TEO 
MENT 

iUKE 1975 


COMPl i 
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RESURVEY METHODOLOGY 



The nucleus of the entire OTIS system is the interface of projected man- 
power demand with estimated manpower supply. The forecasts of manpower 
demand are employer-based. Therefore, an assessment of the accuracy of 
these employer forecasts is crucial to an evaluation of the OTIS demand data 
collection methodology. Consequently, the Project Monitoring Committee 
decided to survey 500 employers who participated in the Oklahoma and Kentucky 
OTIS surveys. 

This appendix describes the resurvey data collection methodology, includ- 
ing: 

Sample selection 
Interviewer training 
Data collection 
Data processing 

1. SAMPLE SELECTION 

The OTIS surveys in Oklahoma and Kentucky were conducted to develop 
manpower demand forecasts for the entire state. Oklahoma utilized a sample 
of employers and Kentucky attempted a personal interview census. The pur- 
pose of the resurvey was to test the accuracy of the employer forecast and 
OTIS regional forecast by occupation. Therefore, our efforts focused on select- 
ing a uniform resurvey sample. Sample selection in each state was conducted 
as follows. 

(1) Kentucky Sample Selection 

Kentucky attempted a census of manufacturing employees listed in 
the 1972 Directory of Manufacturers, published by the KentucKy Depart- 
ment of Commerce. As of September, 1973, the results of the survey 
were: ^ ^ 

2, 946 employers were in the universe 
2,855 were contacted 



APPENDIX E(2) 



374 were nonmanufacturers, who were thereby eliminated from 
the survey population 

275 firms were determined to be inactive, i.e. , out of busi- 
ness 

69 employers refused to respond 
61 employers were not contacted 



Thus, a total of 2, 175 usable responses exclusive of nonmanufacturing 
,.and inactive firms was received, giving an overall usable response rate 
of approximately 94 percent. Employers responding employ approximately 
214, 000 of the 234,500 manufacturing employees. i 

The resurvey sample also was selected from the 1972 Directory of 
Manufacturers as follows: 



Employers were classified into four groups, based on employ- 
ment size 

The total nuniber of employees in each group was estimated 



Using these procedures, a total of 600 establishments was selected. The 
number of establishments selected in each group is detailed in the follow- 
ing table: 



The sample (number of estal^iishments) for each group was 
set proportional to the number of employees m each group 



Manufacturing Employers 



Number of 
Establishments 



Number 
Selected 



First group (lOO-i- employees) 



520 



3a8 



Second group (50-99 
employees) 



281 



79 



Third group (20-49 employ 
ees) 



526 



65 



Fourth group (under 20 
employees) 



1,353 



68 



Total 



2,680 



600 
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This* sample was verified using the 1973 edition of the Directory 
of Manufacturers. Subsequently, the following categories of employers 
were eliminated: 

Inactive 

Noncooperative in first survey 
Nonmanufacturing and included in directory 
Failed to submit schedule 

Discontinued operations, mergers, acquisitions, and other reasons 
reduced the sample to 486. 

Subsequently, each company was identified by county and grouped 
by region. 

Each region was treated separately to assess the number of 
sites within each. Exhibit E-I, following this page, identifies 
the individual towns within a region and the number of employers 
per town. 

The regions were then grouped to identify the counties with 
the largest number of companies in each county. Exhibit E-II, 
following Exhibit E-I, identifies the seven counties having the 
largest number of companies per county. 

The final step involved the selection of actual companies to 
be resurveyed. Identification of a county cutoff point was 
related to the cost effective administration of the resurvey. 

This process resulted in the selection of the 338 companies that are 
identified on the Scheduling Grid presented in Exhibit E-IIl, following 
Exhibit E-II. The 38 additional companies were included to provide for 
unforeseen problems in the field. 

(2) Oklahoma Sample Selection 

The original OTIS survey in Oklahoma was a sample of employers. 
The largest employers in terms of employment were contacted personally. 
The rf»rnainiixg firms receive survey questionnaires and are contacted only 
if an adequate response to the particular cell was not received. 
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EXHIBIT E-n 
Ecooomic Development Administration 
KENTUCKY SCHEDULING GRID 



Region Companies By County JLatgest^ Total 

#1 U 4 3 2 2 2 1 25 

^ 2 94 3 3 3 22 26 

#3 11 11 2 I 1 I 1 28 

0 4 10 7 5 5 3 2 2 34 

63 32 2 11 IS 

# 6 113 4 3 2 2 2 1 127 

#7 10 9 3 2 2 2 1 29 

#8 411---" 6 

#9 32 1---- 6 

<S!10 8 3 2 1 1 i - 16 

#11 I 1 1 I 1 - - 5 

#12 1 I 1 - - - - . 3 

#13 6 4 4 2 2 1 - * 19 

^14 S 5 3 2 2 1 1 19 

#15 _26 _^ ^ j6 J5 ^ ^ 62 

Subtotals: 224 67 41 29 27 20 15 423* 



This number is less than 486 because of counties falling outside the chait. 
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The 1971 sample was selected as follows: 

OESC records were utiU7.ed to identify all businesses that 
paid a wage to four or more workers in each of 20 weeks. 

The state was divided ipto 11 state -planning districts. 

• The employers in each industry division in each district were 
ranked in descending order by total employment. 

The sample was selected as follows: 

100 percent of the first two quartiles 
20 percent of the third quartile 
5 percent of the fourth quartile 

The selected sample was adjusted to include noncovered firms 
and major employers not otherwise included in the sample 
stratification. 

Overall, the Oklahoma sample included 416 manufacturing and 2.217 non- 
manufacturing establishments employing approximately 375.000 people. 
The response rate for the sample was approximately 70 percent, or 1.865 
reporting units. 

• * 

Due to confidentiality conatraints. the names of the e't»i»loycrs par- 
ticipating in the Oklahoma survey and the number of employees in each 
firm were not available to MSI. Therefore, the Oklahoma sample was ' 
selected from a universe of all establishments in the original sample, 
whether they participated in the OTIS survey or not. Establishments 
were selected as follows: 

. Government establishments were eliminated. 

Counties were grouped into seven geographic regions. 

Within each region, the counties were listed in descending . 
order by number of establishments. 

All counties with 40 or more establishments and a systematic 
sample (every nth company) of other counties within each 
region were selected for sampling. 

Within each selected county, a systematic sample (every nth 
company) was drawn. 
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Using the above procedures, a total of 530 establishments was selected. 
The regional and county breakdown is discussed in Exhibit E-IV, following, 
this page. Subsequently, at the request of the Project Monitoring Cora- 
mittee, an oversample of 200 firms was selected using similar techniques. 
This brought the total number of firms to 730. 

2. TRAINING INTERVIEWERS 

The resurvey interviewers were all college graduates with prior consult- 
ing experience or trained professional sur veyors. All interviewers were trained 
prior to field work. The training included: 

An explanation of OTIS 

A description of manpower forecasting concepts 
An evaluation of the survey documents 
A description of the various occupations 
Practice interview procedures 

3. DATA COLLECTION 

The actual re survey was conducted differently in Oklahoma and Kentucky. 
Each of these resurveys is discussed subsequently. 

(1) Oklahoma Resurvey 

Due to confidentiality constraints, the first step in the Oklahoma 
resurvey was to obtain permission from participating employers to utilize 
the survey questionnaires completed as part of the OTIS survey ccnductpd 
by OESC. Waivers were asked from all employers in the OESC sample 
universe. The waiver requests and form are included in Exhibits V and 
VI, following Exhibit IV. 

After a waiver was received. OESC released the original survey 
document for. use in the resurvey. Many companies in the resurvey 
sample were eliminated because they did not participate in the original 
survey, would- not cooperate in the resurvey, or because interviews 
could not be scheduled during the survey time period. The resurvey 
included approximately 250 firms. 

Each interviewer was given a resurvey document prepared from 
the original survey document, and an introductory guide. The guide and 
a sample resurvey document are included in Exhibits VII and VIII, follow- 
ing Exhibit VI.^ Using the revised OTIS form, the interviewer: 



EXHIBIT E-IV 



BEST COPY AVRIL^BIE 



Bconoxnic Development Administration 

NUMBER OF EMPLOYERS BY RESURVEY 
REGION, COITNTY, AND TOWN 



Region 
I 



Coxuity 

Garfield 
Kay 

Kingfisher 

Texas 

Woods 

Grant 

Cherokee 

Ellis 



Number Of ^ablishment Sampled 



18 
16 

10 
10 
5 
5 
5 



n ComatKhe 10 

Custer 12 

Grady 12 

Kiowa 7 

Tillman 5 

Harmon 5 



III Carter 12 
Pohawatomie 10 
Garvin 8 
Payne 12 
Bryan 12 
Murray 9 
Coal 5 
CSduskee 5 
Pototoc ^ 5 

IV Muskogee 16 

Washington 16 

C^awa 10 

Okmilgee 10 

Craig 15 

Sequoyah 10 

\fcIntosh 6 

Nowata S 

Delaware 5 



Oklahoma 65 

Cleveland 16 

Logan 10 

Canadian 10 



VI Tulsa 55 

Osage V V 10 



VII Pittsburg 15 

LeFIore 10 

[ HaskeU 5 

w Pushmatama 5 



EXHIBIT E-V 

nrct ft . : f • ■ 

Economic Development AdnUaistration 
WAIVER LETTER 




U.S. OEPARTMEIUT OF COMMERCI: 
Economic Oevelopnicnt Administration 



March 29, 1973 



Dear Sir: 

The .Economic DovGlopment Administration has employed MACRO 
SYSTEriS, inc., to conduct an evaluation of the Occupational 
Training Information System (OTIS) currently operating in 
Oklahoma. The purooso of this evaluation is to determine the 
strengths and weaknesses of OTIS and to recommend improvements, 
where necessary. The results of this study should benefit all 
employers and employees in Oklahoma. 

In order to conduct this research, the contractor requires 
assistance from all employers selected to participate in the 
original OTIS survey conducted by the Oklahoma Employment 
Security Commission (OESC) in the summer of 1971. Specifically, 
we need: 

Your permission to use the survey questionnaire which 
was completed by your company or branch operating in 
Oklahoma. OESC will only release the survey document 
3.f you will complete and forward the attached con- 
fidentiality release to MACRO SYSTEMS, INC. A stamped, 
* self -addressed envelope is included for your convenience, 
i 

. ,Your present employment level by individual occupation 
bode. After a review of your questionnaire, the con- 
Itractor will contact you to ascertain your employment 
level. This will be done by a trained personnel spe- 
cialist and should not require more than one half hour 
Qf your time. 

The information is critical for the success of the evaluation, 
and all current data will be subject to the same confidentiality 
constraints as the original, data. 

Due to\ the short period of time available, we ask that you 
complete th^ release and return it as soon as possible. We 
believe the "results of this study will be mutually beneficial. 
Con seque.it lyji we sincerely hope you will assist us in the effort, 




HeAert S. Becker 

Director, Offic^e of Administration 
and Program Analysis 



Enclosvra 



rr 



EXHIBIT E-VI 



Economic Development Admlalstration 



WAiVER FORM 



I hereby r.uUiorizo MACRO SYSTEMS, INC., to examine our 1971 OTIS 

questionnaire on file with the Oklalioma Employment Security Commission. I 
understand the data will remain confidential. 



Signature 



NAME: 



Tn I.E: 



COM) 'ANY: 



ADPRl'SS: 



Ti i.KPiKxu:: :;rMr5KR and area codI': 



ERIC 



EXHffilT E-VII 



BEST cm AVAILABLE 



Ssonomic Development Administration 



OKLAHOMA OTIS SURVEY DESCRIPTION 



I am representing Macro Systems, Inc.. under contract with the 
U. S. Department of Commerce, Economic Development Admini 
stration to study manpower forecasting techniques used by the 
Occupational Training Information System (OTIS) operating in 
Oklahoma. . 



OTIS is a computer bascd^information system designed to 
effectively supply the required trained manpower to the Oklahoma 
labor pool. The system is operated by the State Department of 
Vocational and Technical Education in Stillwater, 

This survey is essential to complete the study and should not 
require much time. The purpose of the study is to determine the 
current level of employment by specific occupation codes and is 
identical to the survey conducted during the summer of 1971. 

Any questions about our authority to conduct the survey should 
be referred to: 

Mr . Will Bowman 

Chief of Research and Planning 

Oklahoma Employment Security Commission 

Oklahoma City, Oklahoma 

Telephone; Ac 405/521-3735 
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Economic Oevelopmeiit Admiaiftration 



SAMPLE RESURVEV FORM 



Apr««V3! F>j>lw»i 
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Obtained current employment by occupation 
Compared forecasts and actual employment 
Attempted to ascertain the rea ns for any discrepancies 

Some of the reasons given for forecast ern 3 are summaarized below. 

Reasons for over forecasting: 

Lost bid for work 
Decreased work 
Overhired 

Eliminated one shift 
Changed to subcontracts 

Reasons for under forecasting: 

More business 
New large contract 

Reasons for shifts in occupations: 

Realigned duties 
Error in original forecasts 
Reclassified employees 
Shifted work to another plant 

•(2) Kentucky Resurvey 

Similar to Oklahoma, resurvey interviewers in Kentucky were given 
an introduction guide. The Kentucky guide is included in Exhibit IX, follow 
ing this page. However, the actual data collection was conducted using 
printouts from the original OTIS survey. A sample printout is included 
in Exhibit X, following Exhibit IX. Using the printout, each interviewer: 

Obtained current emplojrment by occupation 
Compared actual and forecast employment 
Sought to determine the reason for discrepancies 

The reasons given for discrepancies included* 

Reasons for over forecasting: 

Closed department 
Business lagging 



s 



EXMBrrE-a 

Ecottomic Development Administration 
KENTUCKY OTIS SURVEY DESCRIPTION 



Macro Systems^ Inc. is under contract with the U* Department 
of Commerce, Economic Development Administration to study 
manpower forecasting techniques used by the Occupational 
Training Information System (OTIS) operating in Kentucky. 

OTIS is a computer based information system designed to 
effectively supply the required trained manpower to the Kentucky 
labor pooL The system is operated by the Kentucky Bureau of 
Vocational Education. 

This survey is essential to complete the study and should not 
require much time. The purpose of the study is to determine the 
curr;ent level of employment by specific occupation codes and Is 
identical to the survey conducted last fall by the Bureau of 
Vocational Education (OTIS). 

Any questions about our authority to conduct the survey should be 
referred to: 

Dr. .1. Jones 

Director of Information Services 
Kentucky Bureau of Vocational Education 
Frankfort^ Kentucky 



Telephone: 502/564-3096 
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Reasons for under forecasting: 

Picked up new account 
Opened new department 
Added a shift 
Bought another company 

Reasons for shifts in occupations: 

New production lines 

Change in production methods 

Chang;^ in product line 

• 

4. DATA PROCESSING 

The processing of the resurvey data included an initial edit, keypunching, 
computer editing, and a complete review of raw data prior to analyses. Each 
of these operations is described below, 

, (1) Initial Edit 

As the resurvey documents were returned to MSI, they were individ- 
ually reviewed for completeness and clarity. All data that weire inadequate 
were sent back to the field and completed, if possible, or omitted from the 
resurvey, if still incomplete. After this initial edit, the documents were 
submitted for machine coding. The specifications utilized by EDA to main- 
tain the original Kentucky OTIS data were utilized for coding the resurvey 
data of both states. 

(2) Keypunching And Data Verification 

* The keypunching of the resurvey documents required over 8, 000 ' 
cards. Because of the large volume of cards, the difficult nature of the 
keypunching, and the need for maximum accuracy, several test runs were 
developed to verify accuracy. After all discernable keypunch ertf'ors were 
removed, a line-by-line check of the data was initiated. 

Each employer* s survey document was matched against the computer 
printout for that company. The following data were checked on an individ- 
ual line basis: 

Region 

Company name and address 
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Resurvey date 

Survey document number 

Occupation line item code . 

Description 
Original employment 
Forecast employment 
Actual employment 

Control totals 

Only after these edits were complete were the data submitted to the Com- 
mittee for review. 

(3) Raw Data Check 

Printouts of the resur\ ey data were submitted to representatives 
of the Project Monitoring Committee for review. These represented the 
resurvey data line item by line item and indicated potential problems 
and /or questions. Subsequently, the printouts were matched against the 
survey instruments and all questions reviewed with the EDA Project 
Officer. After this final review and a series of correction runs, the 
data were arrayed for analysis. 
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RESURVEY DATA ANALYSIS 



The resurvey of employers participating in the original OTIS survey in 
Oklahoma and Kentucky provided a comparison of actual and forecast employ- 
ment by occupation for each resurveyed employer. These data were aggregated 
in different arrays to compare the actual and forecast employment by occupation 
by region and statewide. Consequently, it was necessary to select relevant sta- 
tistics to test the forecast accuracy. After extensive analysis, the Project Mon- 
.itoring Committee decided to use a set of three statistics to evaluate the accuracy 
of the OTIS demand data. Each of these statistics, including the derivation, limits, 
special cases, and interpretations, is described below. 

1. ' U STATISTIC 

The U Statistic was developed by Henri Theil-^ and has been used previously 
^ to evaluate the accuracy of employer forecast of manpower demand. The formula 
for the U Statistic is: 



where P and A are the predicted employment change and actual employment change, 
respectively. 

The U Statistic measures the seriousness of a given forecast error by its 
square. For example, the mean square prediction error for a set of n observa- 
tions is: 



The root mean square (RMS) prediction error is obtained by taking the square 
root of the above mean square prediction error. Thus, the RMS has the same 
dimensions as the predictions and realizations. 

T/ Then, Henri, Applied Economic Poyecastiqg. Rand McNally & Company, Chicago, 1966. 
2/ Mcser, Collctte H. , An Evaluation Of Area. Skill Surveys As A Basis For Manpowear PoUcies . an unpubmhed 
doctoral dissertatios at the Univeisity of Wlsconin, 1971. 
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The U Stat tic» or inequality coefficient of n pairs, is obtained by divid- 
ing the RMS prediction error hy the square root of the mean successive differ- 
ence of realizations. The result is the positive square root of: 

n (p. - A.f 

i=l .2 
£ A. 
1 

where P and A are predicted and actual changes in employment. Thus. U=0 
only if tKe forecasts are all perfect, i. e. » perfect for all occupations. Also, 
11 = 1 when the prediction procedure leads to the same RMS error as a naive no- 
change extrapolation. In summary, by using the inequality coefficient, one 
measures the seriousness c " a prediction error by the quadratic loss criterion 
in such a way that the zero corresponds to perfection and the unit with the loss 
associated with a no-change extrapolation. It will be clear that the inequality 
coefficienl has no finite upper bounds which is tantamount to saying that it is 
possible to do considerably worse than by extrapolating on a no^-change basis^ 
ffowever, the U value of an incorrect no-change forecast is 1*0 regardless of ' 
the magnitude of the error because the original and forecast employment are 
equal. 

For computational purposes, the U Statistic was reduced by substitutions » 
as follows: 




where P. and A. equal predicted and actual changes^ respectively. It can be 
seen from thi&., that: 

P. - D - o 
I 

where {: and o are predicted and original employment, respectively; and that 

A. - a - o 
1 



where a and o are the actual and original employment^ respectively. Substitu- 
tion shows that: 



\ 
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2 I [ (p - o) - (a " o) 
Z (a - o)*- 



i(p - a) 



7 



I (a - o)2 



U 



f 5:(P 


- a) 


i(a 





Analysis of this formula indicates that several special cases can occur. 
When the actual level of employn^ent determined by the resurvey is the same 
as the original level of employment, the denominator of the formula computes 
as zero* Since division by zero is undefined, the following criteria were 
selected if a-o 0: 

If r(p-a) 0 then U was set equal to zero, representing a per- 
fect forecast. 

If I {p-a)/0 then U was originally set to <x> \to correspond to 
the commonly accepted definition of a real Viumber divided by 
zero. In order to complete regression comWitations, all 
rases of U oc> were redefined as 10*0. LogicaTTyr-^Ms means 
that an error value of oo percent was redefined to equfil 1000 
percent. 

Anoiher special t^ase occurs the nuxnexcitor oi the formula "h^-v-ero* vVhen 

this happens: 

[f i(a-o)-0 then U was set equal to zero as above. 

If i(a-o)/0 then the U v/as set equal to zero. The basis for 
this was a perfect forecast being made as shown by r(p-a) 
being zero. 

2. STATISTIC I 

Statistic f is a relatively simple statistic that relates the forecast error to 
total actual employment. The formula for this statistic is: 

. , Total Forecast - Total Actual 
Statistic [ Total Actual 
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Statisti^I is computed using only total forecast and total actual employment of 
the employer or particular aggregation. Thus, errors in the individual occu- 
pational forecast comprising the total forecast can be offset. 

Special cases occur when the employer either went out of business or 
forecasted going out of business. Those cases were handled as follows: 

If actual employment was zero or the company was out of busi- 
ness and the forecast employment was zero, then: 

0-0 

Statistic I = ^ = 0 

If actual employment was zero or the company was out of busi- 
ness and the forecast was positive, then: 

x-0 

Statistic I = = « (reduced to 10.0) 

3. STATISTIC II 

Statistic II relates the forecast error to the actual change in employment 
over the forecast period and is computed as follows: 

_ Total Forecast - Total Actual 

statistic u - ^^^^^ Actual - Total Original 

Similar to Statistic I, this indicator allows canceling of internal errors and 
considers only total em:jloyment of the employer or other aggregation. In the 
case of a no-change fort^cast. Statistic II is always 1.0 because total forecasts 
employment equals total original employment. 

Special cases occur as follows: 

♦ If actual employment was zero and forecast employment was 
zero, then: 

Statistic ir = ^ ~- 0 
0-x 

If actual employment was zero and forecast employment was 
not zero, then: 

Statistic n - = real number 
0-x 
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) 

If forecast employment was zero and actual employment was 
not zero, then: 

Statistic II = = = real number 
y-x y-x 

If original employment equals actual employment, then: • 

Statistic II = = ^ =00 (reduced to 10.0) 
x-x 0 
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^\^^W tKt>V-^ Economic Development Administration 

giSl ^^^^ DISTRIBUTION OF THE U STATISTIC 



BY REGION IN OKLAHOMA 



Number of 
Employers 

With a U . _„ — ^ ^, 

Statistic of:,. I i I i I TZ 1 i ifi ^ ^ 



2 1 



2 4 1 5 - - - 15 



.0001- .1999 1 ' - - - 1 - - " " 



.2000- .3999 - 
.4000- .5999 - 1 



- - - 2 - 1 - 3 

1 . - 1 2 6 1 - - 12 



,6000- .7999 -11 3-2-42-- 

.8000- .9999 1 4 1 1 - 8 4 8 1 1 1 30 

l.OOOO 4 3 1 6 7 16 10 16 1 5 3 72 

1. 0001 - 1.2500 - 2- .1735--1 19 

1.2S01 - 1.5000 111 - -521--2 13 

1.5001 - 1.7: - _ - 1 - X 



i.750i - 2.0000 



3 
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Economic Devneiopment Adm inisOatlon 

DtSTRmUTION OF STATISTIC I . 
BY HECION IN OKlAHOKtA 



Nunilwr of 
fcmploycri 
With a 
Statistic I of 

Over 1. 000 
.901 « 1,000 
.801 - ,im 
.701- .800 

. tm - . 700 
.r>oi - .600 

.451- »500 

,401- .450 

.^Sl- .400 

. 301 - . ^$0 

.251- .300 

.201 • .250 

.151- .200 

,101- ,150 

.051- .100 

.001 - .050 
0 

.001 - .050 

,051- ^lOO 

. 101 - . 

.151 • .200 

.201 - .250 

.251 « .^00 

. 101 - .350 

.351- .400 

.401- .4b0 

.451 ,500 

.501 - .600 

,601- .700 

. 701 - .800 

.801- .900 

.901 - 1. 000^ 
_Owr i.OOO 

Total* by Region 



Regipn 



I 
2 
1 

5 
6 
6 
i 
1 
2 
1 

'l 
2 
1 



1 
1 

I 

1 

2 
1 
2 
4 

I 



i 
1 
1 
4 
1 
4 
S 
6 
6 
I 
6 
I 
I 
I 



10 



it 



16 



11 



12 



44 



22 



52 



Tota. ,1 
1 

1 

\ I 

1 
4 

2 
5 
S 
6 
9 
8 
18 
23 
26 
21 
12 
12 
7 
7 
2 
2 
2 
1 
3 
2 
1 
1 
2 
2 

J 

193 
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Economic Development Administration 

DiSTOlBUTlCN or STATISTIC II 
BV REGION IN OKLAHOMA 



.500 
.450 
,400 
.350 
.^00 
.250 



Number of 
Kmploycps 
With a 
Statistic :t of : 



Over 2.000 
X.7\l * 2.000 

1.501 - i.rso 

l,2Si * J.SOO 

1,001 - 1,250 

.<K)I - 1,000 

.801 - .i^OO 

. 701 - , 800 

.601* .700 

.501 - ,60O 
.451 - 
.401 m 
. ^51 - 
.301 - 
.25$ - 
.201 - 

.151- .200 

,101- ,150 

.051- .100 

.001 - .050 
0 

.001 - .050 

.051- .100 

, mt - . j ^ 

.151- .200 
.201 - .250 
.251- .^0 
. :*01 ^ , 550 
,^51- .400 
.401 - .450 
. 451 - .500 
.50i- .600 
.601 - .700 
,701- .SOO 
,80t • .900 
,901 - l.OOO 
1.001 - 1,250 
1.2$1 - 1.500 
1.S01-. U7S0 
1.751 -2.00O 
Ov«r2,0Q0 



Tocalt fay Regioi: 
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Economic Development Admtolitxatioa 

DISTRIBUTION OF THE U STATISTIC 
BY REGION IN KENTUCKY 



Number of 
Enjployeis 
With a U 

Statistic of; 



.CXJOi- .1999 



.2000- .3999 



.4000- .5999 



.6000- .7999 



.8000- .9999 1 1 



1.0000 1 8 



1.0001 - 1.2500 



I.2S01 - I.SQOO 



1.5001- 1.7500 



1.7501- 2.0000 1 



Region 



1 16 2 1 1 



11 11 



3 
1 
1 
2 



2 
1 
1 



64 11 



10 
5 
1 
I 



a 

3 



10 



1 

3 



14 



6 
1 



15 



6 

20 
15 
3 

1 . 
1 



Total 
33 

2 

3 

9 
25 
137 
49 
15 

4 

7 
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EcoQOXUic Drvelojmiejit Admiwbtration 

DIS i-RIBUTlON OF STATIST IC \ 
BY RECtON IN KENTUCKY 



Number of 
Statistic. ! of^ 

Owr X.OOO 

.801- .iW 
.800 
.601 - »700 
,501* .600 
.451- .500 
.401 

.301 
.251 
,201 
.151 



Region 



4r^ 

400 
^50 
^00 
,250 
,200 



.101- .150 
,051- .100 
,001 - .050 
0 

.001 « .050 
.OSl- .100 
. 101 - . i 50 
.151- .200 
.201- ,250 
.251- .300 
.301- ,%S0 
.351 - .400 
.401 - .450 
.451- .500 
.501- .600 
.601 - .700 
.701 - .800 
.801- .900 
.901 - t.OOO 
Over 1. 000 

Total* by Region 



19 
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Eccanomic Dcvclppwnt AifministiatlOA 

DlSTRmUTION or STATISTIC U 
BY REGION IN KENTUCKY 



With A 
Statistic i: of; 



Owf 2.000 
I. 751 * 2.CXX) 
i. - l.7">0 
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RESURVEY SUMMARY DATA 
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APPENDIX I 
OTIS SUPPLY ADJUSTMENT PROCEDURES 
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OTIS SUPPLY ADJUSTMENT PROCEDURES 



There are five primary sources of manpower supply df^ta used in this 
report, i.e.. the Oklahoma State Department of VocationJ?.: and Technical Edu- 
cation, the Governor's Comprehensive Manpower Planni^ig Staff, the State 
Accrediting Agency, the Oklahoma Employment Security Commission, and the 
Oklahoma Board of Nurse Registration and Nurse Education. 

The Oklahoma State Department of Vocational and Technical Education 
provides information on four categories of manpower supply, i. e. . high school 
vocational program graduates, post high school vocational program graduates, 
adult vocational program graduates, and Manpower Development Training Act 
(MDTA) graduates. 

The figures entered into the tables in Chapter II for secondary and post- 
secondary vocational and technical students are calculated in the foUowing 
manner. The first phase of the problem was to find the percentage of the 1971- 
1972 students who have dropped out or completed each of the vocational programs 
and to Hnd out how many are available for job placement. This was done by 
saarching the student accounting system for: 

Those who dropped out of school and are employed full time 
in the field for which they were trained (VE-6000-R-1, Code 6) 

The number of students who are unknown (VE-6000-R-2, Code 9) 

Those who are not available for placement <VE-6000-R-2, Code 
0, 1, 2. and 3) 

Those who are available for placement {VE-6000-R-2, Code 4, 
5. 6. 7. and 8) 

The total number with completion response (VE-6000-R-1. 
Code 1 through 8) 

The total number enrolled in the program {VE-6000-R) for 
each occupational objective 
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The percentage of students who dropped out of school and are employed 
full time in the field for which they are trained or completed the program and 
were available for the labor maiket were calculated by: 

- a ^ d f^ 
^"a + d + b + c ^e 

If there was insufficient information to calculate the percentage, the per- 
centage was based upon OTIS Cycle Three Report, Supplement Five , "A Follow- 
Up Study of Oklahoma Vocational and Technical Education Graduates and Drop- 
outs; 1968-1969 and 1969-1970," August 31. 1972. 

The second phase was to calculate the number of students available for 
the labor market by accumulating the number of students who completed the 
program (VE-6000-R-1. Code 1) from the 1971-1972 student accounting system 
and multiplying it by the percentage worked out above for each occupational 
objective. 

Secondary programs, other than reimbursed vocational-technical programs 
provide input into the labor market. Information on what happens to these grad- 
uates is not available. Research that is in progress should provide information 
so thai supply data from this can be included in future OTIS reports. 

The figures entered into the tables in Chapter II for adults are calculated 
by searching the student accounting system and ether available records for: 

The number of adult preparatory students 

. The number of adult supplementary students in adult classes 
for each occupati^ lal objective 

The formula used to calculate percentage available for the 1^ >or market 

was: 

t>r g V Rfi V (VE-^OOO-R'g* Code 4, 5, 6, 7, 8) 
" g + h ^ (VE-6000-R-1. Code 1) 

The factor . 86 was used to eliminate duplicated enrollment. The adult 
enrollment for 1971-1972 was used to calculate the figures in the table in 
Chapter II. 

One hundred percent of the graduates in the MDTA programs are listed 
as available to the labor market. 
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The Governor's Comprehensive Manpower Planning Staff provides data 
on the number of graduates to be produced by the federal training programs 
not associated with the State Department of Vocational and Technical Education. 

Data on private school graduates were obtained from the license applica- 
tion required annually by House Bill 1403. This licensing procedure is super- 
vised by the State Accrediting Agency. 

The Oklahoma Employment Security Commission provides the number of 
qualified registrants who are available to fill jobs listed in the OTIS Report. 

The Oklahoma Board of Nurse Registration and Nurse Education and the 
Oklahoma State Department of Vocational and Technical Education provide data 
on the number of nurses that are available for the labor market. 
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BLS EMPLOYMENT DATA COLLECTION 
AND FORECASTING PROGRAMS 
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I. INTRODUCTION 



This appendix presents a summary of three employment data collection 
and forecasting programs conducted by the Bureau of Labor Statistics (BLS) of 
the Department of Labor. These programs are the: 

National /State Industry-Occupation Matrix (matrix) Progiam 
Tomorrow's Manpower Needs (TMN) Program 
Occupational Employment Statistics (OES) Program 

Essentially, these programs are federal /state data collection and analysis 
efforts. Collectively* their purpose is to gather information to meet federal, 
state* and local manpower information needs. 

Several BLS staff members assisted in the preparation of this appendix. 
Messrs. Richard Dempsey, Russel Flanders, and David Evans, and Ms. Nancy 
Kent were particularly helpful in reviewing our test and explaining new programs 
being implemented by BLS. 
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II. NATIONAL/STATE INDUSTRY -OCCUPATION MAI RIX PROGRAM 



The National /State Industry-Occupation Matrix Program provides the 
occupational composition of the labor force in the state by industry for 1970. 
In addition, a multipurpose computer system is provided for utilization of the 
matrix and other information to update and project state and regional matrices. 
Currently, the base year of the matrix is the census year so that detailed infor- 
mation gathered in the decennial census can be utilized in developing the matrix. 
For example, the occupational composition of the labor force in particular 
industries is reported in the U. S. Census Bureau publication Occupation By 
Industry . 

The industry-occupation matrices present occupational profiles covering 
approximately 425 occupations in approximately 200 industries which represent 
all types of economic activity. Also, the matrix provides data that can be used 
as a basis for projecting future manpower requirements. Specifically, the tables 
display changes in the composition of the labor force over time. In turn, 
employment levels for a particular year may be predicted by industry and occu- 
pational category. Subsequently, the occupational totals in each industry can 
be summed to project the manpower requirements by occupation for the entire 
economy. 

This section details the procedures employed by BLS to develop a base 
period matrix. Additionally, the methods utilized to predict occupational pat- 
terns and project industry employment are explained in detail. 

1. THE DEVELOPMENT OF THE BASE PERIOD MATRIX IS BASED ON 
INDUSTRY AND OCCUPATIONAL EMPLOYMENT DATA 

Development of the base period matrix requires: 

Data depicting total employment by industry and the occupa- 
tional composition of industries 

Annual employment data. This information facilitates the 
examination of changes in occupational patterns by industry 
and an analysis of these changes in relation to external factors 
such as changes in technology. 
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A variety of sources provide these requisite data. Principai sources are des- 
cribed below. 

(1) Two Data Collection Programs Provide Information On Industry 
Employment 

Two ongoing data collection programs provide information which is 
used to develop estimates of the total employment in the U. S. and in each 
matrix industry. Specifically, these programs are: 

Current Population Survey (CPS) Program - -Data collected 
each month through a nationwide sample of 52, 500 households 
are recognized as the authoritative basis for estimating total 
employment in the U. S. All classes of workers are sampled, 
including self-emplojred and unpaid family workers as well as 
wage and salary workers. The monthly estimates for a year 
are a^^eraged to provide the estimate of total employment pre- 
sented in the Industry-Occupation Matrix. 

Current Employment Statistics (CES) Program - -Data collec- 
ted monthly and annually from a sample of approximately 
160,000 employees provide detailed industry estimates for 
private wage and salary workers who comprise the majority 
of the labor force. 

The data collected through the CES are augmented by information 
from the following sources. 

Survey Of Governments 
Unemployment Insurance Statistics 
U. S. Civil Service Commission 
Population Census 

Data collected through the CES and other sources facilitate estimating 
total employment by industry. The estimates for the industries are manip 
^ ulated to agree with ishe estimate of total employment derived from the 
CPS. Hence, a link is established between the BLS wage and salary worke 
statistics and the total employment statistics derived from the population 
survey. 
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(2) Two Methods Are Used To Estimate Occupational Employment 
By Industry 

The decennial census provides the information used to distribute 
total U.S. employment among occupations and industries. Nonetheless^ 
several factors limit the use of census data in compiling occupational 
employment information for the matrix. 

Census data are compiled every 10 years; thus, the use of 
these data for trend analyses is limited. 

Census data differ from the CPS data used to project total 
U.S. employment and from CES data used to estimate detailed 
industry employment. 

Occupational information for the entire Ipoor force may not 
be available from the census due to non-responses and under- 
counting. 

Therefore, other reliable sources which provide data more frequently 
are used to estimate occupational employment. These sources include: 

BLS employer surveys for scientists and engineers 

Office of Education data on the employment of teachers and > 
librarians 

Regulatory agency data on the occupational composition of 
interstate industries, e. g. , railroais, airlines, telephone 
and telegraph companies, and pipeline companies 

Professional society data for medical and health occupations 

U. S. Postal Service occupational employment information 

Federal Civil Service Commission statistics on emplojrment 
by occupation in Federal government agencies 

A second method of collecting occupational data is used for occupa- 
tions for which employment data are not available annually or periodically. 
The population census Industry By Occupation tables are used for estimat- 
ing employment in these occupations. However, the tables must be adiusted 
to allvjw for undercounting and other differences with data from preferred 
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sources. In particular, ad jufetmentsi^ involve forcing census estimates 
alternately to industry emplo^^rit^^otals and occupational group totals. 
This iterative manipulation is repeated until each matrix cell is consis- 
tent with both sets of marginal controls. 



<3) The Industry And Occupational Employment Data Are Combined To 
Produce The Base Period Matrix 

The industry and occupational d^ta gathered through the processes 
described above are used to produce a matrix. This matrix displays the 
ratio of the employment for each occupation in the industry to the total 
employment in the industry. These ratios are used in conjunction with 
detailed industry emplojrment information to provide meaningful data for 
estimating future manpower requirements. 

2. OCCUPATIONAL EMPLOYMENT PROJECTIONS ARE DEVELOPED USING 

ESTIMATES OF INDUSTRY EMPLOYMENT AND OCCUPATIONAL STAFFING 

patterns" — - - 

BLS utilizes the Industry-Occupational Matrix to project future manpower 
requirements. These projections are based on a series of predictions about the 
economy in the projection year. e. g. , the estimated real Gross National Product 
(GNP) and the unemployment rate for the target year. Given these predictions, 
two steps are followed to project future labor demand by occupation. 

Total manpower requirements in each detailed industry are 
projected. 

Trends in the proportion of each occupation in each industry 
are analyzed and staffing patterns (ratios) for the target year 
are developed. 

(1) Three Methods Of Analysis Are Used To Project Industry Employment 

The first step in the development of projections for industry employ- 
ment is to estimate the level of real GNP. Once real GNP has been esti- 
mated, total employment is distributed by industry in several ways. The 
actual distribution depends on the data available, the level of industry 
detail required, and the characteristics of the industry. 

Three different methods cf analysis are used to project industry 
requirements. 
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Input /Output Analysis is used to translate GNP into industry 
employment reCt^irements. In this method, GNP is distributed 
to the final demand sectors. The output of each industry is 
determined through input /output relations which show the 
value addea to output in the industry of final demand. Pro- 
ductivity in each industry is projected to derive the labor 
required per unit of output. Together* total output and labor 
required per unit determine labor requirements by industry. 

Regression Analysis also is used to'estimate employment in 
each industry. Employment is projected through a system of 
equations which relate total employmenl; in each industry to 
significant variables or model assumptions, e.g., GNP, pop- 
ulation, and unemployment rate. 

Analysis Of Key Factors which are expected to influence the 
growth of individual industries is conducted. This approach 
is utilized when past trends in employment are not expected to 
be indicative of future trends or when other methods of analysis 
provide unacceptable results. A variety of regression equa- 
tions are developed and tested. The equations providing the 
best statistical results are used to project employment. 

The detailed industry employment projections resulting from these analyt- 
ical approaches are compared and evaluated to arrive at the best approxi- 
mation of projected industry employment. Similar to the base period matrix 
development approach, the totals for the industry projections are forced to 
agree with the assumed level of total employment in the target year. 

(2) Data From Many Sources Are Analyzed To Project Industry 
Occupational Structure 

The occupational composition of the work forces in particular indus- 
tries are projected after careful analysis of historical occupational com- 
position data. Data on occupational employment in each industry are 
obtained from the population census. ^is» noted earlier, these data are 
supplemented with data from the following sources: 

U. S. Postal Service data on employment by occupation 

Regulatory agency data on the occupational composition of 
certain interstate industries 



APPENDIX J(7) 



Federal Civil Service Commission statistics on employment 
by occupation in Federal government agencies 

Office of Education data on the employment oi teachers and 
librarians 

Public Health Service data on the medical &nd health occupa- 
tions 

BLS employer surveys for scientists and engineers 

Initially, historical patterns of changes in an industry's occupational 
composition are projected to the target year by the use of trend lines. The 
trend for each occupational ratio, whether projected from census data or 
other sources, is extended to the target year. The difference of the ratio 
in the base year of the matrix and the ratio in the target year is added to 
the ratio in the base period Industry-Occupational Matrix. In result, a 
first approximation of industry occupational structure in the target year 
is produced. 

Occupational trend data are analyzed further to identify factors which 
caused past changes in the occupational structure. Subsequently, the prob- 
able impacts of these factors on occupational employment are estimated 
for the target year. Occupational ratios for the target year are adjusted, 
based on the impact of these factors and of emerging factors not reflected 
in the historical statistics. The resulting ratios depict the projected occu- 
pational composition of particular industries in the target year. 

(3) Estimated Occupational Ratios Are Used In Conjunction With Projected 
Industry Employment To Forecast Future Manpower Requirements 

The final step in the projection process involves applying the occu- 
pational ratios to the detailed industry employment projections. The 
figures produced by this comparison represent an estimate of the occupa- 
tional requirements by Industry for the target year. Data for the individual 
occupations may be summed across industries to provide estimates of total 
occupational demand. Further, other industry employment projections 
based on different assumptions may be developed because the occupational 
ratios are developed independently of industry employment data. When 
the occupational ratios are applied to these industry employment projec- 
tions, occupational requirements by industry may be identified for varying 
economic conditions. 
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III. TMN PROGRAM 



During the past several years, BLS has developed information on current 
and projected state and local occupational manpower requirements while continu 
xng to compile and analyze national manpower information. BLS published a 
four-volume bulletin called "Tomorrow*s Manpower Needs," in 1969. This 
bulletin contained national occupational and Industrial emplo3rment data and 
provided techniques for projecting occupational manpower requirements at the 
state and local level. More importantly, the projection techniques formed the 
core of the TMN Program. Program principles include: 

Local projections should be developed within the context of 
national economic and industrial trends. 

Mechanically produced projections should be reviewed by 
knowledgeable local analysts. 

Projections which are consistent with other factors jaffecting 
the future of the area should be developed systematically. 

The projection techniques utilized must ensure flexibility and 
program continuity. The techniques adopted for the program 
involve application of National /State Industry-Occupation 
Matrix patterns to estimate the occupational composition of 
industrial employment in the state for base and target years. 
Results are summed to occupational totals and a change factor 
for each occupation is calculated. These change factors are 
then applied to estimates of base period occupational employ- 
ment to yield projections of occupational requirements. 
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IV. OES PROGRAM 



Three BLS programs were merged under the heading of the OES program 
in May, 1973. The three component programs were: 

,The OES Survey 

The National /State Industry-Occupation Matrix System 

The State And Area Occupational Manpower Projections Program 

The resulting OES program is a national /state cooperative venture involving 
BLS the Manpower Administration, and state employment security agencies. 
The 'program is designed to respond to the increasing number of requests for 
reliable information on current and projected occupational employment at the 
state and local levels. 

1, THE OES SUilVEY 

In 1970 BLS, the Manpower Administration, and a number of state employ- 
ment security agencies joined to initiate the OES survey. This mail survey pro- 
gram is designed to produce estimates of occupational employment by industry 
for the entire nonagricultural wage and salary labor force. While the immediate 
fioal of the program focuses on producing occupational employment estimates 
For states and subdivisions of states, ultimately, the program also will produce 
national level estimates. 

■ Currently. 26 states are participating in this pilot project. The survey 
provides for the collection of sample data on occupational employment PJ^tterns 
of industries. These data, after expansion to represent the population of indus- 
tries, provide meaningful and useful estimates on the occupational composition of 
of the labor force. 

(1) The OES Survey Satisfies Five Information Needs 

Prior to development of the PES survey, many other programs col- 
lected data on the current occupational composition of industries. These 
programs included the Census of the Population. Current Population Sur- 
vey? industry Wage Survey, and Area Skill Survey. Information compiled 
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by these programs was fragmented and inadequate to meet the needs of 
i manpower planners and other data users. Therefore, the OES survey 
w4s designed to achieve the following objectives: 

Develop occupational employment estimates by industry. 
These estimates will provide the basis for producing a time 
series of estimates of employment by occupation. 

Provide data about the occupational composition of industries, 
including: 

Differences in occupational composition within an indus- 
try by size of establishment, process, etc. 

Extent of inter-establishment variability 

Changes in occupational composition in response to 
external factors such as changing technology 

Provide occupational information in a form that permits develop- 
ment and improvement of industry-occupational matrices at the 
state and area levels and, ultimately, at the national level 

(2) The OES Survey Collects Occupational Data 

The OES survey collects data from a sample of employers on the 
occupation:.! composition of industries within each of the cooperating 
states, rhe state employment security agencies analyze and edit the data 
and produce occupational employment estimates by industry. 

Specifically, occupational employment data are collected fj r k>. indus- 
tries thzough mail questionnaires. The OES survey is designed to cover 
all nonagricultural wage and salary emplo3rment. Selected establishments 
receive questionnaires throiigh the mail and are asked to provide informa- 
tion on the occupational composition of the labor force within their estab- 
lishments as of a specified date. The date is chosen to provide data from 
a typical month ip. terms of employment seasonability.- Data are collected 
for pre-listed and employer listed occupations. Only pre-Usted occupa- 
tions are used from the first round of sampling. 
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The survey of manufacturing industries conducted during 1972 
utilized 33 separate questionnaires to collect occupational employment 
data at the three-digit Standard Industrial Classification (SIC) level. On 
each questionnaire, a list of approximately 80 occupations tnat are com- 
mon to many different manufacturing industries was provided. In addition 
to the standard list, each questionnaire included a second list of other 
occupations that are important to the particular industry. Importance 
was determined by the number of employees in these occupations. A ddx- 
tionally, other occupations requiring a substantial period of educaUon or 
training were listed for selected industries. 

Employers receiving questionnaires are requested to provide the 
following information for the designated reference date: 

Total number of workers employed in the listed occupations 

Total number of apprentices in specifically designated occupa- 
tions 

Total number of workers engaged primarily in research and 
development activities for specific scientific and techmcal 
occupations 

BLS personnel validate the data supplied by employers for completeness 
and reasonableness after occupational employment estimates are generated. 

(3) Data Collected From The Employer Samp le Is Used To Produce 
Oi^upational Employment Estimates By lndustry 



Occupational employment estimates are prepared for each industry 
size class, e.g., 500-999 employees, on an industry-by-industry basis. 
The occupational estimates for each size class are developed at the most 
detailed SIC level permitted by the sample. These estimates are relatively 
detailed because occupational employment patterns are generally most 
similar among establishments which are of the same size and engaged m 
manufacturing similar products or performing simUar services. 

The process used to derive occupational employment estimates from 
the sample data involves four basic steps: 
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The reported occupational employment figure for an establish- 
ment is multiplied by the establishment's sample weight. 

The weighted occupational emplojmaent figure for the establish- 
ment is summed with similar data for all other sample establish- 
ments in the same industry size class (cell). 

The sum of the weighted occupational employment data is 
divided by the sum of the weighted total employment for all 
reporting establishments in the cell. This produces the occu- 
pational ratio for the cell. 

The ratio is multiplied by the total industry employment figure 
for the cell, as determined from ES 202 data, to yield the esti- 
mated number of workers in each occupation in the cell. 

This process can be expressed by the formula below. 




where : 

pQ = Estimate for occupation P in an industry size cell 

- Reported employment for occupation P by number 
of establishments in an industry size cell 

M = The ES 202 benchmark employment for the industry 
size cell 

^ Reported total employment in the ith establishment 
in an industry size cell 

= The reciprocal of the sample weight or the sampling 
ratio of the ith establishment in an industry size cell 

The occupational estimates produced for each cell can be aggregated 
at various levels to produce data on the occupational composition of different 
levels of industry detail, e.g., three-digit or two-digit SIC code industries. 
These estimates provide valuable state and local level information hereto- 
fore unavailable from a single data source. Specifically, occupational 
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employment estimates for states and state subdivisions can be used to 
construct^ state and local level industry-occupational matrices for all 
wage and salary employment classifications. These matrices, in turn, 
may provide the basis for projecting occupational employment require- 
ments. 

2. THE NATIONAL/STATE INDUSTRY-OCCUPATION MATRIX SYSTEM 

Early in 1972, BLS inaugurated a new program called the National /State 
Industry- Occupation Matrix System. This system was developed with the coop- 
eration of the Manpower Administration and state employment security agencies. 
The purpose of the system is to develop occupational information at the state 
and local le ,1s. 

The system is designed to provide a set of 51 (all states and the District 
of Columbia) individual matrices consistent in format, concept, and data base 
with the BLS national matrix. A matrix will be developed for each state and 
the District of Columbia. The data base for the program is a special tabulation 
of industry by occupation by class of worker from the 1970 census for each state. 
The system also includes preparation of occupation-specific death and retire- 
ment rates for each state that can be used to help estimate total occupational 
demand. These rates were developed using special census tabulations of occu- 
pational employment distributed by age and the BLS standard working life tables. 

The first goal of the system is to provide an employment matrix for each 
state which covers over 400 occupations and 200 industries and can be used to 
generate projections of occupational requirements with greater accuracy than 
projections based on national patterns alone. Another goal is to provide a flexible, 
multipurpose computer system that will allow a state to update its matrix, e.g., 

, supplement the census-based matrix with data from the OES survey and prepare 

^ sub-state estimates. 

Currently, a number of states are nearing completion of the design phase, 
including preparation of the new 1970 national matrix and development and docu- 
mentation of the computer software package. Most state agencies have reviewed 
the basic census input data and prepared special industrial employment controls 
covering 200 industrial sectors and six classes of worker categories. Plans call 
for implementation of the system to begin in early 1970. 
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3. THE STATE AND AREA OCCUPATIONAL MANPOWER PROJECTIONS 
PROGRAM ^ 

Effective November, 1972, BLS was charged with the responsibilities for 
pruviding consultation and technical assistance to state feinployment security 
agencies concerning state and area occupational manpower projections. This 
assistance program requires: 

Continuous research efforts to develop and improve methods 
of preparing state and local manpower projections 

Development and maintenance of technical manuals, guidelines* . 
aiid other appropriate materials presenting projection proce- 
dures to the state agencies 

Centralized processing by state agencies of state data related 
to the development of occupational demand projections 

4. I NTERIM MANPOWER PROJECTION PROGRAM 

Projections based on the state matrix program cannot be available in time 
for Fiscal Year 1975 planning. Therefore, the Bureau has recently undertaken 
an interim project to develop state and sub-state projections for the FY 1975 
manpower planning cycle: 

This project is being conducted in conjunction with the Manpower Adminis- 
tration. Specifically, BLS is responsible for developing and coordinating technical 
aspects of the program, while state emplosrment agencies are responsible for 
organizing data files and determining and disseminating the occupational projec- 
tions. A centralized data processing capability is being funded by the Manpower 
Administration. 

During the first phase of the project, BLS will research and test various 
procedures for developing sub- state area projections and pilot test the project 
in one or more local labor market areas. State projections for some 400 occu- 
pations will be developed using a modified TMN methodology. These projections 
are scheduled for completion in mid-October, while projections for smaller 
geographic areas were completed in December, 1973. Efforts were made 
,to maximize the level of detail of both occupational and geographic data, accord- 
ing to the constraints of available data and projection reliability. 



